-- Logs begin at Mon 2022-08-22 04:47:11 UTC, end at Mon 2022-08-22 06:05:31 UTC. -- Aug 22 05:30:29.150024 dv-cinder-853910-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 22 05:30:29.162774 dv-cinder-853910-1-smb devstack@keystone.service[82114]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 05:30:29 2022] *** Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: nodename: dv-cinder-853910-1-smb Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: machine: x86_64 Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: clock source: unix Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: pcre jit disabled Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: detected number of CPU cores: 4 Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: current working directory: / Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: detected binary path: /usr/bin/uwsgi-core Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: your processes number limit is 47680 Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: your memory page size is 4096 bytes Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: detected max file descriptor number: 2048 Aug 22 05:30:29.163769 dv-cinder-853910-1-smb devstack@keystone.service[82114]: lock engine: pthread robust mutexes Aug 22 05:30:29.164700 dv-cinder-853910-1-smb devstack@keystone.service[82114]: thunder lock: enabled Aug 22 05:30:29.164700 dv-cinder-853910-1-smb devstack@keystone.service[82114]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 22 05:30:29.164700 dv-cinder-853910-1-smb devstack@keystone.service[82114]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 05:30:29.203892 dv-cinder-853910-1-smb devstack@keystone.service[82114]: Python main interpreter initialized at 0x55ee570159c0 Aug 22 05:30:29.203892 dv-cinder-853910-1-smb devstack@keystone.service[82114]: python threads support enabled Aug 22 05:30:29.203892 dv-cinder-853910-1-smb devstack@keystone.service[82114]: your server socket listen backlog is limited to 100 connections Aug 22 05:30:29.203892 dv-cinder-853910-1-smb devstack@keystone.service[82114]: your mercy for graceful operations on workers is 90 seconds Aug 22 05:30:29.204268 dv-cinder-853910-1-smb devstack@keystone.service[82114]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 05:30:29.204355 dv-cinder-853910-1-smb devstack@keystone.service[82114]: *** Operational MODE: preforking *** Aug 22 05:30:29.204608 dv-cinder-853910-1-smb devstack@keystone.service[82114]: *** uWSGI is running in multiple interpreter mode *** Aug 22 05:30:29.204608 dv-cinder-853910-1-smb devstack@keystone.service[82114]: spawned uWSGI master process (pid: 82114) Aug 22 05:30:29.204809 dv-cinder-853910-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 22 05:30:29.205530 dv-cinder-853910-1-smb devstack@keystone.service[82114]: spawned uWSGI worker 1 (pid: 82145, cores: 1) Aug 22 05:30:29.205856 dv-cinder-853910-1-smb devstack@keystone.service[82114]: spawned uWSGI worker 2 (pid: 82146, cores: 1) Aug 22 05:30:29.207323 dv-cinder-853910-1-smb devstack@keystone.service[82114]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 05:30:33.533573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:30:33.533573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: from cryptography.utils import int_from_bytes Aug 22 05:30:33.534359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:30:33.534359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: from cryptography.utils import int_from_bytes Aug 22 05:30:33.535017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:30:33.535017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: from cryptography.utils import int_from_bytes Aug 22 05:30:33.535479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 05:30:33.535479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: from cryptography.utils import int_from_bytes Aug 22 05:30:33.584108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 05:30:33.584285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 05:30:33.584450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] command line args: [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 05:30:33.584720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 05:30:33.584900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ================================================================================ {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 05:30:33.584989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 05:30:33.585155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] admin_token = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.585247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 05:30:33.585351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] command line args: [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 05:30:33.585435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] config_dir = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.585570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.585653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 05:30:33.586046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ================================================================================ {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 05:30:33.586305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] admin_token = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.586490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] config_source = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.586581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] config_dir = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.586678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] debug = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.586761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.586880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] config_source = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] debug = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.587910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] list_limit = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] log_config_append = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] list_limit = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] log_config_append = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] log_dir = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.588936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] log_file = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] log_dir = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] log_file = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.589962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.590907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.591924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.592091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.592259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.592380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.592481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.592630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.592872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] publish_errors = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] publish_errors = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.593996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] standard_threads = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] standard_threads = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.594931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] use_journal = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] use_json = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] use_journal = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] use_stderr = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] use_json = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] use_syslog = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] use_stderr = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] use_syslog = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.595993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.596145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 05:30:33.596241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.596438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.596515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.596682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.596852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.596924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.597975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.598929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.599894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.600898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.601884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602821 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.602978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.603059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.603219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.603296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.603461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.603537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.604243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.604324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.604479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.604565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.604712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.604787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.604963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.605987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.606901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.607980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.608928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.609949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.610871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.611978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.612928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.613991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.614937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.615901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.616853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.617972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.618983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.619133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.619208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.619987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620321 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.620951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.621937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] auth.external = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] auth.external = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.622920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] auth.password = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] auth.password = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] auth.token = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] auth.token = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.623945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.624920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] credential.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] credential.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.625871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626362 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.626985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.627976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.628092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.628254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.628375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.628518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.628602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.628761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.628842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.629967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.630996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.631974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.632961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.633898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.634856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635275 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.635929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.636010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.636215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.636312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.636469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.636551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.636939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.637935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.638970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.639944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.640919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.641866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.642975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.643949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.644914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.645002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.645298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.645379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.645535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.645623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.645784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.645881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.646983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.647071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.647222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.647356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.647483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.647609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.647740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.647867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.648008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.648136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.648345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.648477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.648606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.648742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.648887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.649856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.650862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.651991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.652072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.655864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.655981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.656924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.657950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658310 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] role.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] role.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] role.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] role.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.658960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.659995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660332 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.660939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661906 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.661981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662130 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.662967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.663956 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664529 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.664934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.665982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.666677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.666771 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.666925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.667954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.668960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.connection = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.connection = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.669978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.670925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.671869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.672850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82145) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 05:30:33.673734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 05:30:33.673898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82146) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 05:30:33.707543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.707775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.707864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.708004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.708090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.708349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.717215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.717448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.750437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.750592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.750664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.750740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.807415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.807753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.855715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.855967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.856552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:33.856792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.018818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.019012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.019127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.019386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.019557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.019674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.019800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.019906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.020073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.020170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.020362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.020589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.043315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.043564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.043655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.043783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.043920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.044040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.044296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.044413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.044522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.044767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.044902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.045011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.045201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.045357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.060904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.061029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.073991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.074933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.075063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.075153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.075276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.075391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82145) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.075739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82146) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 22 05:30:34.092293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.092453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.092558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 05:30:34.098279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 05:30:34.098366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.098431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.098506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 05:30:34.098571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 22 05:30:34.098632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.098692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.098752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.098811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.098879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.098941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.099001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.099061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.104346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.104502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.104648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.104809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.104911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.105096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.105200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.105393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.112219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.112452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.115066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.115336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.115665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.115749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.115814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.115909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.116009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.116219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.116315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.116496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.116619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.116771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.116914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.117154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.117332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.117423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.117724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.117810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.118011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.118097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.118290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.118376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.141293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.144293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.144380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.144449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.144513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.144574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.147690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.147937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.148024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.148254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.148362 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.148539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.154636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.154932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.155117 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.155399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.159027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.159329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.159586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.159683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.159892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.160006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.160221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.160519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.160614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.160804 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.160891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.161090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.161202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.161368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.161454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.161641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.179202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.179494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.179611 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.179843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.184273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.184412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.187470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.187563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.187780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.187896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.192061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.192264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.195221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.195329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.198646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.198776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.198960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.199073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.199256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.199353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.199550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.199638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.199834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.199920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.200132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.200251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.216114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.216436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.216526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.216708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.216823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.217002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.217234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.217318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.224098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.224233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.225655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.225759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.225942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.226025 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.229138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.229230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.229432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.229517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.229739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.229844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.230038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.230133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.230319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.230401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.241598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.241695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.241893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.241990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.242180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.242268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.242456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.242541 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.242734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.242821 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.243019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.243103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.243308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.243398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.259248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.259346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.262338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.262431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.265244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.265333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.266674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.266760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.268147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.268284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.268467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.268555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.268755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.268858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.275320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.275463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.276875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.276971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.279780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.280079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.280245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.280403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.280702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.280791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.280987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.281074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.288956 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.289123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.289256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.289425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.289695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.289785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.297113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82145) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.297223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82146) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 22 05:30:34.297779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.297865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.297931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.297994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.298056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.298116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.298186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.298250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.298469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.298587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.298754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.299005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.299140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.299290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.299579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.299676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.299854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.299977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.300142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.300419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.300506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.300702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.300805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.300974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82145) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.301069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.301249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82146) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 22 05:30:34.335556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee570159c0 pid: 82145 (default app) Aug 22 05:30:34.335970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ee570159c0 pid: 82146 (default app) Aug 22 05:30:34.339310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9aaa-415d-46b7-8dcd-6d251384aedf None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:34.339607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9aaa-415d-46b7-8dcd-6d251384aedf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:34.339927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a9aaa-415d-46b7-8dcd-6d251384aedf None None] PATH_INFO: `/v3` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:34.344072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Mon Aug 22 05:30:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:41.761107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486cb1-f97a-45be-959d-e8743c249194 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:41.761633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486cb1-f97a-45be-959d-e8743c249194 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:41.761633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486cb1-f97a-45be-959d-e8743c249194 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:41.765885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:41.772059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:41.772491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:41.772656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:41.843204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: INFO dbcounter [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] Registered counter for database keystone Aug 22 05:30:41.861911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG oslo_db.sqlalchemy.engines [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82145) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:30:41.868207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writer thread running {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:30:42.046958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG passlib.handlers.bcrypt [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82145) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 05:30:42.047323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG passlib.handlers.bcrypt [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82145) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 05:30:42.102286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:42.103908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:42.230466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 05:30:42.652053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486cb1-f97a-45be-959d-e8743c249194 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:42.719797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: INFO dbcounter [None req-57486cb1-f97a-45be-959d-e8743c249194 None None] Registered counter for database keystone Aug 22 05:30:42.741765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG oslo_db.sqlalchemy.engines [None req-57486cb1-f97a-45be-959d-e8743c249194 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82146) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 05:30:42.747861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writer thread running {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 05:30:42.864755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486cb1-f97a-45be-959d-e8743c249194 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:42.869359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82ae1e1-4607-4cc1-86ba-c01f7822edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:42.870002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae1e1-4607-4cc1-86ba-c01f7822edf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:42.870307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae1e1-4607-4cc1-86ba-c01f7822edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:42.870574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82ae1e1-4607-4cc1-86ba-c01f7822edf1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:42.878816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ae1e1-4607-4cc1-86ba-c01f7822edf1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:42.930083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a82ae1e1-4607-4cc1-86ba-c01f7822edf1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 05:30:42.930380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82ae1e1-4607-4cc1-86ba-c01f7822edf1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:42.939772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Aug 22 05:30:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:30:42.945643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:42.959918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80daf75-6516-4dad-acee-1af0ff191c8f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:42.966843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf783c-baf1-4c3b-9525-8830162f73d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:42.967972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf783c-baf1-4c3b-9525-8830162f73d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:42.968284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf783c-baf1-4c3b-9525-8830162f73d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:42.968585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf783c-baf1-4c3b-9525-8830162f73d7 admin admin] PATH_INFO: `/v3/projects/db1aad17b68042eda5d90f159ce8fc85` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:42.970169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf783c-baf1-4c3b-9525-8830162f73d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=db1aad17b68042eda5d90f159ce8fc85)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:43.022139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b2bf783c-baf1-4c3b-9525-8830162f73d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 22 05:30:43.022485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf783c-baf1-4c3b-9525-8830162f73d7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:43.027544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Aug 22 05:30:42 2022] GET /identity/v3/projects/db1aad17b68042eda5d90f159ce8fc85 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:44.878347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3994df0-a667-4b77-a4bd-a097ce08b459 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:44.878876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3994df0-a667-4b77-a4bd-a097ce08b459 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:44.878876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3994df0-a667-4b77-a4bd-a097ce08b459 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:44.882988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:44.888402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6901a-e894-4b8d-acc3-bd4d4f3912a1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:44.888808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6901a-e894-4b8d-acc3-bd4d4f3912a1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:44.888964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6901a-e894-4b8d-acc3-bd4d4f3912a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:44.908459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-acd6901a-e894-4b8d-acc3-bd4d4f3912a1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:44.909974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-acd6901a-e894-4b8d-acc3-bd4d4f3912a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:44.918280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 22 05:30:45.184368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3994df0-a667-4b77-a4bd-a097ce08b459 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:45.196385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3994df0-a667-4b77-a4bd-a097ce08b459 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:45.201103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67702cd9-bfbe-4285-b1fc-430855660160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:45.201701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702cd9-bfbe-4285-b1fc-430855660160 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:45.201982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702cd9-bfbe-4285-b1fc-430855660160 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:45.202258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67702cd9-bfbe-4285-b1fc-430855660160 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:45.209717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702cd9-bfbe-4285-b1fc-430855660160 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:45.211764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67702cd9-bfbe-4285-b1fc-430855660160 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:45.221144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Aug 22 05:30:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 05:30:45.226791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6901a-e894-4b8d-acc3-bd4d4f3912a1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:45.236421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6901a-e894-4b8d-acc3-bd4d4f3912a1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:45.240829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e20c4-1a5e-4583-9850-7cedb8fca887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:45.241455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e20c4-1a5e-4583-9850-7cedb8fca887 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:45.241741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e20c4-1a5e-4583-9850-7cedb8fca887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:45.242021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e20c4-1a5e-4583-9850-7cedb8fca887 admin admin] PATH_INFO: `/v3/users/3e08281e8e384df6a2e274a09e73725b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:45.243325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e20c4-1a5e-4583-9850-7cedb8fca887 admin admin] RBAC: Authorizing `identity:get_user(user_id=3e08281e8e384df6a2e274a09e73725b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:45.245242 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e20c4-1a5e-4583-9850-7cedb8fca887 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:45.246761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Mon Aug 22 05:30:45 2022] GET /identity/v3/users/3e08281e8e384df6a2e274a09e73725b => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:47.197337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded7fc-1c0c-48e8-a194-eaa3522753f1 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:47.197949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded7fc-1c0c-48e8-a194-eaa3522753f1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:47.197949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded7fc-1c0c-48e8-a194-eaa3522753f1 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:47.199618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:47.204737 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f410e4-33e3-457d-84e8-4e533e6c55f1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:47.205192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f410e4-33e3-457d-84e8-4e533e6c55f1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:47.205441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f410e4-33e3-457d-84e8-4e533e6c55f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:47.223469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f0b1-26a8-48c0-b369-f93ac3ce7620 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:47.223761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f0b1-26a8-48c0-b369-f93ac3ce7620 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:47.224019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f7f410e4-33e3-457d-84e8-4e533e6c55f1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:47.224124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466f0b1-26a8-48c0-b369-f93ac3ce7620 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:47.225346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f7f410e4-33e3-457d-84e8-4e533e6c55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:47.225496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:30:47.231159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:47.231453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:47.231739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:47.272820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG passlib.handlers.bcrypt [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=82146) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 22 05:30:47.273241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG passlib.handlers.bcrypt [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82146) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 22 05:30:47.306351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:30:47.319429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:47.321080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:47.419347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:30:47.572464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f410e4-33e3-457d-84e8-4e533e6c55f1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:47.596462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:47.677889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f410e4-33e3-457d-84e8-4e533e6c55f1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:47.686573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:47.714121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:47.714757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:47.715046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:47.715353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:47.726220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:30:47.735076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:30:47.740324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:30:47.741312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:30:47.743333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:47.792997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f6e3-8bff-4805-833e-f048968f9e1b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:47.795238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:47.823601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:47.829601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:47.830459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:47.830756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:47.831136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:47.842530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a7a34-b394-47bf-8378-292122d2674b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:47.877574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:47.878179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:47.878458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:47.878733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:47.879405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:30:47.879708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:47.881138 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:47.892934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:30:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:47.898415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:47.901506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:47.903032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:47.997646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f7ead-3e05-4ac6-91cd-0a23609af7e4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:48.000598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:30:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 05:30:48.006172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:48.009017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:48.031733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:48.032482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:48.032670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:48.032946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] PATH_INFO: `/v3/users/3e08281e8e384df6a2e274a09e73725b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:48.034080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] RBAC: Authorizing `identity:get_user(user_id=3e08281e8e384df6a2e274a09e73725b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:48.035536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:48.037329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 9/17] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:30:47 2022] GET /identity/v3/users/3e08281e8e384df6a2e274a09e73725b => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:48.043142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:48.057936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:48.106738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70890c08-4912-4592-aa36-054de0fe469a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:48.140315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:48.141168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:48.141450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:48.141722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:48.142162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce3dca-2949-44ab-85f9-d0b2e0c5d7da None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:48.159951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:48.161574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:48.176796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:48.177429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:48.177716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:48.177996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:48.179124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:30:48.179374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:30:48.180382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:30:48.181876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:30:48.181876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:30:48.181876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:30:48.181876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 9/18] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:30:48.182317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:48.187472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 10/19] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:48.187623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:48.188353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:48.243812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:48.268949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:48.289510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d0196-0ed0-4317-b0f0-f1d7b5d99596 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:48.292135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47756e9b-db8b-4e50-af46-fe336ea0e646 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:48.325119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408fbdcd-05ac-4934-a668-20f130e880fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:48.325740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fbdcd-05ac-4934-a668-20f130e880fb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:48.325989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c56383-1753-4d92-976d-f897a0717c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:48.326094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fbdcd-05ac-4934-a668-20f130e880fb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:48.326297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408fbdcd-05ac-4934-a668-20f130e880fb None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:48.326591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c56383-1753-4d92-976d-f897a0717c86 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:48.326874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c56383-1753-4d92-976d-f897a0717c86 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:48.326971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fbdcd-05ac-4934-a668-20f130e880fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:30:48.327151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c56383-1753-4d92-976d-f897a0717c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:48.327242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fbdcd-05ac-4934-a668-20f130e880fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:48.327871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c56383-1753-4d92-976d-f897a0717c86 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.domain.id=default, user.id=3e08281e8e384df6a2e274a09e73725b) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:30:48.328182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c56383-1753-4d92-976d-f897a0717c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:48.328676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408fbdcd-05ac-4934-a668-20f130e880fb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:48.329640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c56383-1753-4d92-976d-f897a0717c86 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:48.336440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Aug 22 05:30:48 2022] GET /identity/v3/role_assignments?user.id=3e08281e8e384df6a2e274a09e73725b&scope.domain.id=default&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:48.349331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:50.586295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608e051-0720-4666-b22d-6b479944e0e6 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:50.586761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608e051-0720-4666-b22d-6b479944e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:50.586761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608e051-0720-4666-b22d-6b479944e0e6 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:50.588657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:50.594174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94adb-a98a-41d7-aa18-7b290c14688a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:50.594596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94adb-a98a-41d7-aa18-7b290c14688a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:50.594770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94adb-a98a-41d7-aa18-7b290c14688a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:50.630105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2816c4-91a4-4bab-a6b0-f1e4d92d88f2 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:50.630718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2816c4-91a4-4bab-a6b0-f1e4d92d88f2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:50.631208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2816c4-91a4-4bab-a6b0-f1e4d92d88f2 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:50.636537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 13/23] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:50.636657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f8c94adb-a98a-41d7-aa18-7b290c14688a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:50.636657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f8c94adb-a98a-41d7-aa18-7b290c14688a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:50.643757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa40b9-c2aa-48bb-ab3f-c48ba3352cb0 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:50.644048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa40b9-c2aa-48bb-ab3f-c48ba3352cb0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:50.644374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa40b9-c2aa-48bb-ab3f-c48ba3352cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:50.682794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-89aa40b9-c2aa-48bb-ab3f-c48ba3352cb0 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:50.684001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-89aa40b9-c2aa-48bb-ab3f-c48ba3352cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:50.865498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 11/24] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:30:50.867104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917024c3-2009-4bfd-958f-d1e55c6e4ea9 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:50.867582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917024c3-2009-4bfd-958f-d1e55c6e4ea9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:50.868028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917024c3-2009-4bfd-958f-d1e55c6e4ea9 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:50.869548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 12/25] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:50.889985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ba1b-3cae-4f4c-9151-d6defbefa625 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:50.890561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ba1b-3cae-4f4c-9151-d6defbefa625 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:50.891327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ba1b-3cae-4f4c-9151-d6defbefa625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:50.894515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 14/26] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:30:50.952304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0bd1ba1b-3cae-4f4c-9151-d6defbefa625 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:50.953825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0bd1ba1b-3cae-4f4c-9151-d6defbefa625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:51.064716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:51.110523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 13/27] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:30:51.384701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa40b9-c2aa-48bb-ab3f-c48ba3352cb0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:51.428054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ba1b-3cae-4f4c-9151-d6defbefa625 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:51.470693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:51.502097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa40b9-c2aa-48bb-ab3f-c48ba3352cb0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:51.543789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:51.545830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:51.546339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:51.546810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:51.567455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:30:51.575517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:30:51.576729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:30:51.577491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:30:51.580156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 15/28] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:30:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:30:51.586855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:51.631587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ba1b-3cae-4f4c-9151-d6defbefa625 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:51.701722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931430a8-c3a1-4629-8a41-10ad521b1772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:51.702398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931430a8-c3a1-4629-8a41-10ad521b1772 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:51.702716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931430a8-c3a1-4629-8a41-10ad521b1772 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:51.703025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931430a8-c3a1-4629-8a41-10ad521b1772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:51.729217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931430a8-c3a1-4629-8a41-10ad521b1772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:51.730733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931430a8-c3a1-4629-8a41-10ad521b1772 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-931430a8-c3a1-4629-8a41-10ad521b1772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:30:51.757459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:30:51.758366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:30:51.759247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:30:51.759247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:30:51.759247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:30:51.765043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:30:51.766354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8ea1-9a54-4dee-a802-2ed8194a4176 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:51.766646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8ea1-9a54-4dee-a802-2ed8194a4176 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:51.766929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc8ea1-9a54-4dee-a802-2ed8194a4176 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:51.771612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 15/30] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:51.772733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8ea1-9a54-4dee-a802-2ed8194a4176 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:51.793335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e946a5-c47f-4b0e-89b1-463ee75ff94f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:51.824697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:51.847888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:51.848555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:51.851097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:51.851230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:51.851909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:30:51.852276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:51.854330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:51.856758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:51.868856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 16/31] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:51.869716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:51.949262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc8ea1-9a54-4dee-a802-2ed8194a4176 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:51.990627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:51.991571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:51.992074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:51.992627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:51.995258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:51.997076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:52.042362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efa99e-e749-4a9e-85cc-febb92e9c009 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:52.097180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662f626-6c5a-4aa3-990d-b37323984819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:52.097180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f626-6c5a-4aa3-990d-b37323984819 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.097180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f626-6c5a-4aa3-990d-b37323984819 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.097180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f626-6c5a-4aa3-990d-b37323984819 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.097566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662f626-6c5a-4aa3-990d-b37323984819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:30:52.097566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662f626-6c5a-4aa3-990d-b37323984819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:52.097566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662f626-6c5a-4aa3-990d-b37323984819 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:52.114613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 17/32] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:52.116010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74875a1-8ede-45d8-b1fe-aa99ef3f9aeb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.116367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74875a1-8ede-45d8-b1fe-aa99ef3f9aeb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.116933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74875a1-8ede-45d8-b1fe-aa99ef3f9aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.137353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f74875a1-8ede-45d8-b1fe-aa99ef3f9aeb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:52.138889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f74875a1-8ede-45d8-b1fe-aa99ef3f9aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:52.242248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:52.259977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 16/33] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Aug 22 05:30:51 2022] POST /identity/v3/roles => generated 219 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:30:52.261780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:52.273324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 18/34] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:30:52.277243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74875a1-8ede-45d8-b1fe-aa99ef3f9aeb None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:52.402761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:52.422489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9f199-8065-48b3-99cb-63b5453f6c75 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:52.452273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74875a1-8ede-45d8-b1fe-aa99ef3f9aeb None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:52.469801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf878b-0ca6-45e2-927d-3be823f5dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:52.472401 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf878b-0ca6-45e2-927d-3be823f5dd79 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.472681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf878b-0ca6-45e2-927d-3be823f5dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.473152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf878b-0ca6-45e2-927d-3be823f5dd79 None admin] PATH_INFO: `/v3/users/3e08281e8e384df6a2e274a09e73725b` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.481302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf878b-0ca6-45e2-927d-3be823f5dd79 None admin] RBAC: Authorizing `identity:get_user(user_id=3e08281e8e384df6a2e274a09e73725b)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:52.481302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf878b-0ca6-45e2-927d-3be823f5dd79 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:52.483056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 17/35] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:30:52 2022] GET /identity/v3/users/3e08281e8e384df6a2e274a09e73725b => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:52.487135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fc56a-cae0-406e-8ea0-a6ee6354052e None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.488706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fc56a-cae0-406e-8ea0-a6ee6354052e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.489004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fc56a-cae0-406e-8ea0-a6ee6354052e None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.490664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 18/36] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:52.495893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fc56a-cae0-406e-8ea0-a6ee6354052e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:52.523227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:52.524113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.525213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.525696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.526554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:52.528226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:52.629567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fc56a-cae0-406e-8ea0-a6ee6354052e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:52.665663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f77d7-9a92-4352-b07d-94c778ea97d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:52.666271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f77d7-9a92-4352-b07d-94c778ea97d0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.666523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f77d7-9a92-4352-b07d-94c778ea97d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.666777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f77d7-9a92-4352-b07d-94c778ea97d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.668033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f77d7-9a92-4352-b07d-94c778ea97d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:52.669557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f77d7-9a92-4352-b07d-94c778ea97d0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:52.671320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 19/37] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:52.672243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e262b-99cf-454a-b97d-cbe82805edce None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.672643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e262b-99cf-454a-b97d-cbe82805edce None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.672905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e262b-99cf-454a-b97d-cbe82805edce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.692032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e83e262b-99cf-454a-b97d-cbe82805edce None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:52.693567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e83e262b-99cf-454a-b97d-cbe82805edce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:52.712152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:52.763224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 20/38] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:30:52.764824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ff85-5270-46d8-9486-74f981b7f9ba None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:52.765225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ff85-5270-46d8-9486-74f981b7f9ba None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:52.765603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0ff85-5270-46d8-9486-74f981b7f9ba None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:52.771080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 21/39] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:52.771080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0ff85-5270-46d8-9486-74f981b7f9ba None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:52.784302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 19/40] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:30:52 2022] POST /identity/v3/projects => generated 301 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:30:52.784302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:52.866454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:52.973752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9318b18-7db3-4641-8f52-a95402b83622 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:52.981395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0ff85-5270-46d8-9486-74f981b7f9ba None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:53.045007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763a62e-70c5-4e98-8454-781f39bf9c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:53.045820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763a62e-70c5-4e98-8454-781f39bf9c11 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:53.046206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763a62e-70c5-4e98-8454-781f39bf9c11 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:53.046626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763a62e-70c5-4e98-8454-781f39bf9c11 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:53.047438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763a62e-70c5-4e98-8454-781f39bf9c11 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:53.049199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763a62e-70c5-4e98-8454-781f39bf9c11 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:53.129308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 22/41] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Aug 22 05:30:52 2022] POST /identity/v3/roles => generated 225 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:30:53.131098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ff732-f0a5-4289-b153-d756ffb139d8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:53.131592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ff732-f0a5-4289-b153-d756ffb139d8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:53.131866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ff732-f0a5-4289-b153-d756ffb139d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:53.138028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:53.138797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:53.139160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:53.139481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] PATH_INFO: `/v3/domains/default/users/3e08281e8e384df6a2e274a09e73725b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:53.143736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3e08281e8e384df6a2e274a09e73725b, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:53.146083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:53.155207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e02ff732-f0a5-4289-b153-d756ffb139d8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:53.156597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e02ff732-f0a5-4289-b153-d756ffb139d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:53.171157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:53.225834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1361 bytes} [Mon Aug 22 05:30:52 2022] PUT /identity/v3/domains/default/users/3e08281e8e384df6a2e274a09e73725b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:30:53.225834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:53.260620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:30:53.416082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:53.417635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27110ce-171b-4cc4-992f-612f1f315b1f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:53.458368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:53.459224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:53.459649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:53.459933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:53.460995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:53.462421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:53.545672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Aug 22 05:30:53 2022] POST /identity/v3/roles => generated 223 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:30:53.559284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ff732-f0a5-4289-b153-d756ffb139d8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:53.688290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ff732-f0a5-4289-b153-d756ffb139d8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:53.731364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34d2ef7-b34f-4fea-9faf-451d78512293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:53.732021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2ef7-b34f-4fea-9faf-451d78512293 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:53.732364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2ef7-b34f-4fea-9faf-451d78512293 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:53.732646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34d2ef7-b34f-4fea-9faf-451d78512293 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:53.733866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d2ef7-b34f-4fea-9faf-451d78512293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:53.735338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34d2ef7-b34f-4fea-9faf-451d78512293 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:53.737034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:53.745315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:53.856291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6bd01-497c-4001-9f56-97634d0cdca7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:53.891075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba5388-ebc3-49c2-adba-463ea729fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:53.891715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5388-ebc3-49c2-adba-463ea729fdd1 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:53.891986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5388-ebc3-49c2-adba-463ea729fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:53.892297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba5388-ebc3-49c2-adba-463ea729fdd1 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:53.892957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba5388-ebc3-49c2-adba-463ea729fdd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:53.894438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba5388-ebc3-49c2-adba-463ea729fdd1 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:53.988083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:30:53 2022] POST /identity/v3/projects => generated 312 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:30:55.208621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1641c3-9050-4ead-ab5e-8d978b86f653 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:55.209144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1641c3-9050-4ead-ab5e-8d978b86f653 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:55.209240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1641c3-9050-4ead-ab5e-8d978b86f653 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:55.210534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:55.216820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed48a-4bd1-48a8-b67e-6031d9567e2f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:55.225915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed48a-4bd1-48a8-b67e-6031d9567e2f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:55.225915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ed48a-4bd1-48a8-b67e-6031d9567e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:55.235855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d21ed48a-4bd1-48a8-b67e-6031d9567e2f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:55.237527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d21ed48a-4bd1-48a8-b67e-6031d9567e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:55.240452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:55.308616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:30:55.581913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1641c3-9050-4ead-ab5e-8d978b86f653 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:55.597510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:55.693195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1641c3-9050-4ead-ab5e-8d978b86f653 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:55.728626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e35915-c1a4-4649-8bbf-e0dd2e3c7692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:55.729266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35915-c1a4-4649-8bbf-e0dd2e3c7692 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:55.729553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35915-c1a4-4649-8bbf-e0dd2e3c7692 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:55.729835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e35915-c1a4-4649-8bbf-e0dd2e3c7692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:55.741441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e35915-c1a4-4649-8bbf-e0dd2e3c7692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c6e35915-c1a4-4649-8bbf-e0dd2e3c7692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:30:55.747865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:30:55.748789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:30:55.749555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:30:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:30:55.756343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed48a-4bd1-48a8-b67e-6031d9567e2f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:55.861116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ed48a-4bd1-48a8-b67e-6031d9567e2f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:55.897172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:55.897797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:55.898086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:55.898368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:55.899062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:30:55.899982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:55.905621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:55.914974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 24/50] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:30:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:55.916319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e6236-86b2-4873-8f52-cb335add491b None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:55.916759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e6236-86b2-4873-8f52-cb335add491b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:55.917049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e6236-86b2-4873-8f52-cb335add491b None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:55.918382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 27/51] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:30:55.920463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:55.923442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:55.923556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182fb2-5d47-4f7f-b8f1-e5a4e64fcc05 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:55.923913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182fb2-5d47-4f7f-b8f1-e5a4e64fcc05 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:55.924084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85182fb2-5d47-4f7f-b8f1-e5a4e64fcc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:55.942407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-85182fb2-5d47-4f7f-b8f1-e5a4e64fcc05 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:55.943636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-85182fb2-5d47-4f7f-b8f1-e5a4e64fcc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:56.017678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 28/52] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:30:56.029681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff818022-9178-472f-91e4-6eeb01914485 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:56.067793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:56.068483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:56.068770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:56.069048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] PATH_INFO: `/v3/users/3e08281e8e384df6a2e274a09e73725b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:56.070208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] RBAC: Authorizing `identity:get_user(user_id=3e08281e8e384df6a2e274a09e73725b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:56.072299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:56.073878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 25/53] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:30:55 2022] GET /identity/v3/users/3e08281e8e384df6a2e274a09e73725b => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:56.079669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85182fb2-5d47-4f7f-b8f1-e5a4e64fcc05 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:56.082367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:56.188658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85182fb2-5d47-4f7f-b8f1-e5a4e64fcc05 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:56.224111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:56.224770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:56.225055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:56.225345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:56.226488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:56.228051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:56.229671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 29/54] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:56.235609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:56.286705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:56.318047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:56.350647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762f5b8-0866-40ee-8a4f-bdb093b31337 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:56.365794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:56.391829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:56.392482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:56.392777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:56.393063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:56.393810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.domain.id=default, user.id=3e08281e8e384df6a2e274a09e73725b) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:30:56.394125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:56.395582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:56.401217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf7b1-d50c-4f11-b4cc-38363f85d2b9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:56.402014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 26/55] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Aug 22 05:30:56 2022] GET /identity/v3/role_assignments?user.id=3e08281e8e384df6a2e274a09e73725b&scope.domain.id=default&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 530 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:56.439963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711239e-d348-4339-acd4-8df32312c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:56.440577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711239e-d348-4339-acd4-8df32312c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:56.440867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711239e-d348-4339-acd4-8df32312c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:56.441158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711239e-d348-4339-acd4-8df32312c6b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:56.442305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711239e-d348-4339-acd4-8df32312c6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:56.443792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711239e-d348-4339-acd4-8df32312c6b0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:56.445479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 30/56] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:30:56.452072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:56.567032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7aa07-6646-4055-8c0c-8497f6004074 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:56.610871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88172591-28c8-4387-ac12-55e33f9f4ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:56.611407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88172591-28c8-4387-ac12-55e33f9f4ee2 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:56.611698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88172591-28c8-4387-ac12-55e33f9f4ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:56.614226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88172591-28c8-4387-ac12-55e33f9f4ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:56.614226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88172591-28c8-4387-ac12-55e33f9f4ee2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:56.614226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88172591-28c8-4387-ac12-55e33f9f4ee2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:56.618869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:56.701858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 27/57] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Aug 22 05:30:56 2022] POST /identity/v3/projects => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:30:58.604283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee87904-7ed4-421a-9c75-78672eb3ee93 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:58.604746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee87904-7ed4-421a-9c75-78672eb3ee93 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:58.605020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee87904-7ed4-421a-9c75-78672eb3ee93 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:58.606198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 31/58] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:30:58.611490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba302b-7896-48f6-86bf-0b2bfd861cd2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:58.611908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba302b-7896-48f6-86bf-0b2bfd861cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:58.612050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba302b-7896-48f6-86bf-0b2bfd861cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:58.630405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8bba302b-7896-48f6-86bf-0b2bfd861cd2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:30:58.631607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8bba302b-7896-48f6-86bf-0b2bfd861cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:30:58.696933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 28/59] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:30:58.966332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee87904-7ed4-421a-9c75-78672eb3ee93 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:59.170703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee87904-7ed4-421a-9c75-78672eb3ee93 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:59.203609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4540-d0eb-42fd-8562-84c1a1a4a41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:59.204262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4540-d0eb-42fd-8562-84c1a1a4a41e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:59.204552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4540-d0eb-42fd-8562-84c1a1a4a41e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:59.204839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4540-d0eb-42fd-8562-84c1a1a4a41e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:59.205937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c4540-d0eb-42fd-8562-84c1a1a4a41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:59.207374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c4540-d0eb-42fd-8562-84c1a1a4a41e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:59.208952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 32/60] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:30:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:30:59.215460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba302b-7896-48f6-86bf-0b2bfd861cd2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:30:59.312149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba302b-7896-48f6-86bf-0b2bfd861cd2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:30:59.327881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:30:59.345491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f33eb-a798-4a12-aa97-b30ee4bb46a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:30:59.346095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f33eb-a798-4a12-aa97-b30ee4bb46a8 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:30:59.346380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f33eb-a798-4a12-aa97-b30ee4bb46a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:30:59.346658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f33eb-a798-4a12-aa97-b30ee4bb46a8 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:30:59.347312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f33eb-a798-4a12-aa97-b30ee4bb46a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:30:59.348850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f33eb-a798-4a12-aa97-b30ee4bb46a8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:30:59.506020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 29/61] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:30:59 2022] POST /identity/v3/users => generated 275 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:02.582745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df98fb-ec99-4e77-87ab-139620bf3341 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:02.583233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df98fb-ec99-4e77-87ab-139620bf3341 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:02.583233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df98fb-ec99-4e77-87ab-139620bf3341 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:02.584756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 33/62] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:02.593649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61720e-8f47-45d3-814f-5f0009297f53 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:02.594076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61720e-8f47-45d3-814f-5f0009297f53 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:02.594253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61720e-8f47-45d3-814f-5f0009297f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:02.621579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5d61720e-8f47-45d3-814f-5f0009297f53 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:02.622958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4493-52c4-458d-93ff-dcec83572445 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:02.623244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4493-52c4-458d-93ff-dcec83572445 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:02.623582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4493-52c4-458d-93ff-dcec83572445 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:02.625097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 34/63] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:02.626187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5d61720e-8f47-45d3-814f-5f0009297f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:02.629949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10457076-0dab-4bfc-b4ef-c869c9f17d81 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:02.630493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10457076-0dab-4bfc-b4ef-c869c9f17d81 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:02.630964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10457076-0dab-4bfc-b4ef-c869c9f17d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:02.646724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:02.655357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-10457076-0dab-4bfc-b4ef-c869c9f17d81 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:02.661746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-10457076-0dab-4bfc-b4ef-c869c9f17d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:02.717118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 30/64] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:02.799774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 35/65] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:02.885760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c416-02cc-40c4-a8fd-1a9fb1d1db2a None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:02.886454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c416-02cc-40c4-a8fd-1a9fb1d1db2a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:02.886954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c416-02cc-40c4-a8fd-1a9fb1d1db2a None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:02.888573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 31/66] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:02.893975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c56a18-4e1d-4fac-9a6f-7c88d48ce1ae None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:02.894267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c56a18-4e1d-4fac-9a6f-7c88d48ce1ae None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:02.894550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c56a18-4e1d-4fac-9a6f-7c88d48ce1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:02.917194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-28c56a18-4e1d-4fac-9a6f-7c88d48ce1ae None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:02.918395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-28c56a18-4e1d-4fac-9a6f-7c88d48ce1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:02.994266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c416-02cc-40c4-a8fd-1a9fb1d1db2a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.003114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 36/67] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:03.061653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee67b-5f1b-4d3c-9c49-82f279fc34b9 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.062264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee67b-5f1b-4d3c-9c49-82f279fc34b9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.062766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ee67b-5f1b-4d3c-9c49-82f279fc34b9 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.064427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 37/68] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:03.069168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311bc8b-6321-42ff-9548-965dd4abc505 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.069679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311bc8b-6321-42ff-9548-965dd4abc505 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.070159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311bc8b-6321-42ff-9548-965dd4abc505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.103177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c416-02cc-40c4-a8fd-1a9fb1d1db2a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.104750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2311bc8b-6321-42ff-9548-965dd4abc505 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:03.105164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.106119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2311bc8b-6321-42ff-9548-965dd4abc505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:03.138476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.139363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.139798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.140294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.152124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:03.157120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:03.158233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:03.159169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:03.161133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 32/69] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:03.169129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.205862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.215438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 38/70] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:03.221099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311bc8b-6321-42ff-9548-965dd4abc505 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.329497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c172d7-88d4-4a02-9836-1b9e3866480a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.375382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.376425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.376715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.377275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.377963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:03.378528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:03.380661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:03.381914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2311bc8b-6321-42ff-9548-965dd4abc505 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.391790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 33/71] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:03.393183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.418995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.419635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.419923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.420219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.423136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.431313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:03.436073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:03.436929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:03.437672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 39/72] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:03.438302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.497078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.510698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cab91-aafc-4ab9-a921-3af66b77b5e3 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.541794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f638a76-933e-440d-bf72-4c841614a3b6 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.546106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2a20-604f-4171-9127-b3e355df7960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.546744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2a20-604f-4171-9127-b3e355df7960 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.547031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2a20-604f-4171-9127-b3e355df7960 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.547312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2a20-604f-4171-9127-b3e355df7960 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.558201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2a20-604f-4171-9127-b3e355df7960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-d85c2a20-604f-4171-9127-b3e355df7960 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:03.563153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:03.564089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:03.564897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 34/73] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:03.565531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7c17-e67d-4721-a2db-c281bcff9aff None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.565802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7c17-e67d-4721-a2db-c281bcff9aff None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.566060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7c17-e67d-4721-a2db-c281bcff9aff None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.567442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 35/74] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:03.569177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7c17-e67d-4721-a2db-c281bcff9aff None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.580892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.581525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.581800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.582081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.597201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:03.598654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:03.600275 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 40/75] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:03.605510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.659292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.675492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7c17-e67d-4721-a2db-c281bcff9aff None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.699378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7823ee5-16b9-4901-9905-c71e51efe9e4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.710223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.711087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.711928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.712230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.712900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:03.713207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:03.713785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.714592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:03.722421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 36/76] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:03.723200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.733797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f420a6-6410-41f5-a708-ab307b012de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.734437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f420a6-6410-41f5-a708-ab307b012de2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.735062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f420a6-6410-41f5-a708-ab307b012de2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.735062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f420a6-6410-41f5-a708-ab307b012de2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.745036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f420a6-6410-41f5-a708-ab307b012de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-15f420a6-6410-41f5-a708-ab307b012de2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:03.750447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:03.751325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:03.752076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 41/77] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:03.752749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4006bf-9432-4da3-964d-1c3ce51723cd None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.753243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4006bf-9432-4da3-964d-1c3ce51723cd None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.753243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4006bf-9432-4da3-964d-1c3ce51723cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.770192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fd4006bf-9432-4da3-964d-1c3ce51723cd None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:03.771385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fd4006bf-9432-4da3-964d-1c3ce51723cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:03.823990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46422-5788-429e-a57c-9f59c4bc7709 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.837063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 42/78] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:03.837877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4006bf-9432-4da3-964d-1c3ce51723cd None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.858857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.859472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.859756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.860036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:03.860734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:03.861049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:03.862437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:03.870874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 37/79] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:03.871501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:03.882031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.944816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4006bf-9432-4da3-964d-1c3ce51723cd None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.947747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:03.972917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505ad09-db92-49b4-9522-f8c5895affbb None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:03.982067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:03.982696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:03.983094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:03.983390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.006416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.007045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.007332 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.007614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] PATH_INFO: `/v3/users/3e08281e8e384df6a2e274a09e73725b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.009343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] RBAC: Authorizing `identity:get_user(user_id=3e08281e8e384df6a2e274a09e73725b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.010792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.012407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 38/80] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/users/3e08281e8e384df6a2e274a09e73725b => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:04.016351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.057581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.059062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.090985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.113123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3f7fa-b1f8-42bd-aec3-2eb2086c7e24 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.146484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.147090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.147376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.147658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.148366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:04.148679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.150717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.158442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 39/81] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:04.159216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.164059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 43/82] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:04.165261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.170278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.256419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75991-050e-44e7-b58a-0ff8e2616aaf None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.264027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127847a1-6f12-4e95-920c-3325758681fb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.289342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.290028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.290312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.290590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.291733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.293326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.294897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 40/83] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:04.295647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.299482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.300098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.300406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.300680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.307525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.366493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.367984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.370545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.396508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d27f11-5e33-440f-b1fe-b9cb2ec379ec None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.429166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.429804 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.430618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.430903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.432010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.433516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.435075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 41/84] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:04.435862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.465073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 44/85] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:04.465955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.514808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.538686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37e7aa-2a88-4109-9016-9fe30378a7a8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.562229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4762a4-f7e7-43c4-bd50-b620a82df9f8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.565066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.574639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.575349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.575702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.576045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.577317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.578772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.580623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 42/86] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:04.580623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.603995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.605110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.605404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.605687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.606837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.608321 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.609957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 45/87] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:04.610709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.682053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897cf63-35fc-434b-b0e5-e13f4ed9d2d1 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.707527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa71609-d5b5-4224-8599-5f6449d15740 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:04.715603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.716244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.716540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.716822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.728954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.740988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:04.745470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:04.745470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:04.745470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:04.745470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.745470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.784215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:04.785732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:04.831271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 46/88] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:04 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:04.831973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.874171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.898428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 43/89] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:04.898428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:04.946434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:04.961182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36ce71-5e45-44c1-88d9-66e1a33e901f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.001737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.002662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.002955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.003235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.004768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.008975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.008975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:05.008975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:05.015802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4bef2-3319-49a9-9ec1-8ca91fe50ac5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.051999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.052581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.052871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.053154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.130699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:05.136974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc40b7-86da-4a89-9dcf-260b84d25dae None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.137135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.138608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.181156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.182027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.182690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.183241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.184668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=c72da6899dcd4aa896d76de5911a43ef) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:05.185142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.187134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.187494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:05.199207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 48/91] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:05 2022] GET /identity/v3/role_assignments?user.id=c72da6899dcd4aa896d76de5911a43ef&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:05.200736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:05.298481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 44/92] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:05.299561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:05.372291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fec010-690a-46dc-83f6-c599bd5e5479 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.414315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.415529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.415817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.416098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.417323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.418799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.421795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 49/93] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:05 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:05.422428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:05.457487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:05.514120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54b959-122f-4bbe-bd19-94f3713eb68e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.555561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cf6a-140e-41d0-9984-4931102b3436 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.578509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.579231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.579525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.579913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.580692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=3e08281e8e384df6a2e274a09e73725b) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:05.581011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.583099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.591836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.592532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.592904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.593193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] PATH_INFO: `/v3/projects/0beed92165a34e1badc0c090ec3d1aa3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.594355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] RBAC: Authorizing `identity:get_project(project_id=0beed92165a34e1badc0c090ec3d1aa3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.595842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.596986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 45/94] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:05 2022] GET /identity/v3/role_assignments?user.id=3e08281e8e384df6a2e274a09e73725b&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:05.597528 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 50/95] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:05 2022] GET /identity/v3/projects/0beed92165a34e1badc0c090ec3d1aa3 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:05.598127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:05.603424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:05.614230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:05.708686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:05.718728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36f1b3-057c-4800-83c4-9cc21c11f174 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.785129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb64f0-284f-41ba-a1ec-a63b183d5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.785833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb64f0-284f-41ba-a1ec-a63b183d5099 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.786134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb64f0-284f-41ba-a1ec-a63b183d5099 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.786418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb64f0-284f-41ba-a1ec-a63b183d5099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.787183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb64f0-284f-41ba-a1ec-a63b183d5099 None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=0beed92165a34e1badc0c090ec3d1aa3, user.id=c72da6899dcd4aa896d76de5911a43ef) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:05.787504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb64f0-284f-41ba-a1ec-a63b183d5099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.789225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb64f0-284f-41ba-a1ec-a63b183d5099 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.802820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 51/96] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:05 2022] GET /identity/v3/role_assignments?user.id=c72da6899dcd4aa896d76de5911a43ef&scope.project.id=0beed92165a34e1badc0c090ec3d1aa3&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:05.826808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08703065-6bb7-49e3-bb9c-e1a325c85021 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:05.864927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cafc2d-ff27-4da9-b70c-6ad55082735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:05.865561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafc2d-ff27-4da9-b70c-6ad55082735e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:05.865854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafc2d-ff27-4da9-b70c-6ad55082735e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:05.866143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cafc2d-ff27-4da9-b70c-6ad55082735e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:05.866907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafc2d-ff27-4da9-b70c-6ad55082735e None admin] RBAC: Adding query filter params (role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=c72da6899dcd4aa896d76de5911a43ef) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:05.867231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafc2d-ff27-4da9-b70c-6ad55082735e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:05.868896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cafc2d-ff27-4da9-b70c-6ad55082735e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:05.875580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 46/97] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:05 2022] GET /identity/v3/role_assignments?user.id=c72da6899dcd4aa896d76de5911a43ef&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:07.017356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ea8af-abfb-4706-a7e7-a8a75bc9870d None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:07.017873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ea8af-abfb-4706-a7e7-a8a75bc9870d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:07.017947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ea8af-abfb-4706-a7e7-a8a75bc9870d None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:07.019619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 52/98] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:07.025117 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5fb4-c21c-4f93-89fe-ab454fb91dd9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:07.025559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5fb4-c21c-4f93-89fe-ab454fb91dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:07.025711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5fb4-c21c-4f93-89fe-ab454fb91dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:07.049154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4dec5fb4-c21c-4f93-89fe-ab454fb91dd9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:07.050389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4dec5fb4-c21c-4f93-89fe-ab454fb91dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:07.130776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:07.138727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 47/99] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:07.686621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ea8af-abfb-4706-a7e7-a8a75bc9870d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:07.752361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e37061-0231-428e-b6ba-5d60818146ea None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:07.753024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e37061-0231-428e-b6ba-5d60818146ea None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:07.753510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e37061-0231-428e-b6ba-5d60818146ea None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:07.755071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 48/100] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:07.760819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565644-f84a-40a3-8b26-cbcf4cd42698 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:07.761317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565644-f84a-40a3-8b26-cbcf4cd42698 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:07.761808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb565644-f84a-40a3-8b26-cbcf4cd42698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:07.797187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-cb565644-f84a-40a3-8b26-cbcf4cd42698 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:07.798742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-cb565644-f84a-40a3-8b26-cbcf4cd42698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:07.800752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ea8af-abfb-4706-a7e7-a8a75bc9870d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:07.874845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:07.875534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:07.875785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:07.876064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:07.903891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:07.908854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:07.909783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:07.910557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 53/101] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:07.916712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:07.940638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 49/102] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:07.960881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:08.063844 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5157efe-e985-4a7f-9bd9-026137941535 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:08.083100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521fd0-b9ac-49c8-a4bd-bbe81b856302 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.084028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521fd0-b9ac-49c8-a4bd-bbe81b856302 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.084579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521fd0-b9ac-49c8-a4bd-bbe81b856302 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.086717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 50/103] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:08.093519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4054-24ce-4aaa-a9e3-792e11bea256 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.094098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4054-24ce-4aaa-a9e3-792e11bea256 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.094582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4054-24ce-4aaa-a9e3-792e11bea256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.105796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:08.106418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.106707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.106987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.107665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:08.107972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:08.109387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:08.130426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 54/104] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:08.137248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-bc2d4054-24ce-4aaa-a9e3-792e11bea256 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:08.138556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-bc2d4054-24ce-4aaa-a9e3-792e11bea256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:08.145432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:08.248920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:08.266723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373f102-4846-4ddf-8ac7-3df9414e4507 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:08.297587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 51/105] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:08.312702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4054-24ce-4aaa-a9e3-792e11bea256 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:08.324471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:08.325451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.325943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.326446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] PATH_INFO: `/v3/users/839bab40fd4c472a9e9e323fbd7e1380` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.358476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] RBAC: Authorizing `identity:get_user(user_id=839bab40fd4c472a9e9e323fbd7e1380)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:08.360393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:08.362289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 55/106] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:08 2022] GET /identity/v3/users/839bab40fd4c472a9e9e323fbd7e1380 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:08.368128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:08.424709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:08.486749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4054-24ce-4aaa-a9e3-792e11bea256 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:08.524645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:08.526196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.526702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.527175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.528543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:08.530567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:08.532604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 52/107] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:08.540576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:08.584746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b783ff2-dd3e-4637-8d3f-c99ea889ff53 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:08.662161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e54646-96c5-45b8-9bb4-408c2a958c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:08.662810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54646-96c5-45b8-9bb4-408c2a958c70 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.663103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54646-96c5-45b8-9bb4-408c2a958c70 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.663490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e54646-96c5-45b8-9bb4-408c2a958c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.688559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:08.688734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d856c-5a9f-4a8d-80d4-fa560a2bbfc2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:08.732548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:08.733335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.733626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.734289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.734965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:08.736974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:08.740608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:08.765601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e54646-96c5-45b8-9bb4-408c2a958c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:08.767100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e54646-96c5-45b8-9bb4-408c2a958c70 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:08.839094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 53/108] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:31:08 2022] POST /identity/v3/projects => generated 302 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:08.840310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:08.884779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 56/109] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:08.886842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc011b2-d80f-4685-83a6-82981b2112e3 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.886842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc011b2-d80f-4685-83a6-82981b2112e3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.886842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc011b2-d80f-4685-83a6-82981b2112e3 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.888022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 57/110] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:08.889131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285746-b734-4b75-a8f7-5c77666e1121 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:08.889420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285746-b734-4b75-a8f7-5c77666e1121 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:08.889711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84285746-b734-4b75-a8f7-5c77666e1121 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:08.890916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 58/111] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:08.895836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285746-b734-4b75-a8f7-5c77666e1121 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:08.945199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:08.965203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df20eef-9afb-4f93-b679-8f3060773098 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.006835 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e61aa-fc47-4da2-96e3-a66639f07785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.007543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e61aa-fc47-4da2-96e3-a66639f07785 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.007830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e61aa-fc47-4da2-96e3-a66639f07785 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.008714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e61aa-fc47-4da2-96e3-a66639f07785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.015143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84285746-b734-4b75-a8f7-5c77666e1121 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.020327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e61aa-fc47-4da2-96e3-a66639f07785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-701e61aa-fc47-4da2-96e3-a66639f07785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:09.026372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:09.027236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:09.028013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 54/112] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:09.029259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751d614-1923-4698-a6d6-f06dadcf2390 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.029259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751d614-1923-4698-a6d6-f06dadcf2390 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.030267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751d614-1923-4698-a6d6-f06dadcf2390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.049576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2751d614-1923-4698-a6d6-f06dadcf2390 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:09.050402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2751d614-1923-4698-a6d6-f06dadcf2390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:09.052097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268879a-0ab9-4f36-befa-af424e64ca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.053144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268879a-0ab9-4f36-befa-af424e64ca5b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.053247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268879a-0ab9-4f36-befa-af424e64ca5b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.053514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268879a-0ab9-4f36-befa-af424e64ca5b None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.054661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268879a-0ab9-4f36-befa-af424e64ca5b None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:09.056168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268879a-0ab9-4f36-befa-af424e64ca5b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:09.058913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 59/113] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:08 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:09.059037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6962-9393-4ecf-9d27-036ac0a2a4ac None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.059331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6962-9393-4ecf-9d27-036ac0a2a4ac None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.059615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e6962-9393-4ecf-9d27-036ac0a2a4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.078540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-042e6962-9393-4ecf-9d27-036ac0a2a4ac None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:09.079751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-042e6962-9393-4ecf-9d27-036ac0a2a4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:09.089954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:09.126630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 55/114] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:09.128459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34508b27-399e-416e-8208-4ecc46554f82 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.128896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34508b27-399e-416e-8208-4ecc46554f82 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.129413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34508b27-399e-416e-8208-4ecc46554f82 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.130888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 56/115] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:09.131692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34508b27-399e-416e-8208-4ecc46554f82 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:09.168223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 60/116] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:09.168223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6962-9393-4ecf-9d27-036ac0a2a4ac None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:09.251734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:09.318408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e6962-9393-4ecf-9d27-036ac0a2a4ac None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.358060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6eab3-077f-431f-85bd-280bcbba29c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.358943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6eab3-077f-431f-85bd-280bcbba29c2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.359394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6eab3-077f-431f-85bd-280bcbba29c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.359815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6eab3-077f-431f-85bd-280bcbba29c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.360807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6eab3-077f-431f-85bd-280bcbba29c2 None admin] RBAC: Adding query filter params (role.id=5836edf91f934d0e97a25fc0e178c771, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=839bab40fd4c472a9e9e323fbd7e1380) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:09.361361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6eab3-077f-431f-85bd-280bcbba29c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:09.361892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34508b27-399e-416e-8208-4ecc46554f82 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.363124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6eab3-077f-431f-85bd-280bcbba29c2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:09.374293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 61/117] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/role_assignments?user.id=839bab40fd4c472a9e9e323fbd7e1380&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=5836edf91f934d0e97a25fc0e178c771 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:09.375282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5bba7-1bc1-4157-9d6e-acbc6f4eae40 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.375575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5bba7-1bc1-4157-9d6e-acbc6f4eae40 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.375855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5bba7-1bc1-4157-9d6e-acbc6f4eae40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.418298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0ff5bba7-1bc1-4157-9d6e-acbc6f4eae40 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:09.419554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0ff5bba7-1bc1-4157-9d6e-acbc6f4eae40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:09.424991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.425931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.426389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.426863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.428291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:09.428803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:09.434615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:09.457337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 57/118] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:09.458336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:09.500555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:09.521686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 62/119] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:09.522460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5bba7-1bc1-4157-9d6e-acbc6f4eae40 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:09.561881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:09.580563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d27fdc-7d32-4389-bbec-06b380deaf57 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.623687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.624290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.624584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.626944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.648551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:09.653834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:09.654658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:09.655456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:09.659685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 58/120] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:09.660515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:09.664872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5bba7-1bc1-4157-9d6e-acbc6f4eae40 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.733649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.734300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.734592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.734876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.736815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:09.741871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:09.744811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 63/121] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:09.745638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:09.844565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:09.853522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123f97a-8a61-48a3-ac87-01cfba7d3bc5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.916855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:09.918307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.918961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.919247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.919528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.919808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f802c374-e443-473f-b6ca-6ad03aac0408 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:09.931185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:09.935946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:09.936800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:09.937958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 59/122] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:09.939010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:09.974866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:09.980281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:09.980281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:09.980281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:09.980281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:09.980281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:09.980281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:09.991109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 64/123] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:09.995761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.053914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f62f78-ceea-45c4-8027-e512406067c9 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.104388 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.105160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.105397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.105682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.106985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:10.108633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:10.110465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 60/124] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:10.111129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.127910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b26cd-2530-477f-be23-151df62db180 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.135936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:10.162446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.163396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.163876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.164971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.175899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:10.182194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:10.183131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:10.183904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:10.186317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 65/125] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:10.187521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.213817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:10.231363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c9e29-28a5-4624-bcec-845569651aef None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.270660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.271284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.271579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.271871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.272569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:10.272882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:10.275088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:10.288902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 61/126] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:10.290856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.302081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0289e3-02ac-478d-826c-47f056096af9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.339080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.340044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.340614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.341086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] PATH_INFO: `/v3/users/3e08281e8e384df6a2e274a09e73725b` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.342419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] RBAC: Authorizing `identity:get_user(user_id=3e08281e8e384df6a2e274a09e73725b)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:10.344112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:10.346002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 66/127] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:10 2022] GET /identity/v3/users/3e08281e8e384df6a2e274a09e73725b => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:10.347251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.400014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:10.424114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d31874-a86e-469f-b440-5e89666886bc None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.456393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:10.466632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078615b-3775-4309-937b-b3e0503a8515 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.472376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.473300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.473786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.474700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/c72da6899dcd4aa896d76de5911a43ef/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.477103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] RBAC: Authorizing `identity:create_grant(project_id=427bfb56dd934118aea1eaf475d0900a, user_id=c72da6899dcd4aa896d76de5911a43ef, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:10.478565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:10.508830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.509458 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.509745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.510024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.510710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:10.511020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:10.512450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:10.521465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 67/128] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:10.526502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.548210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 62/129] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:10 2022] PUT /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/c72da6899dcd4aa896d76de5911a43ef/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:10.549395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.722916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cbc0a-9c35-49a9-b1bb-18f89dca12c0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.741867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944ab18-43f5-4539-992d-8063fda5c283 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.783950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.784859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:10.785116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.785574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.785671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:10.786143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:10.786328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.786590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:10.787837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:10.787938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:10.790159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:10.790357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:10.791898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 68/130] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:10 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:10.792687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 63/131] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:10 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:10.792788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.801171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:10.814321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:10.819014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:10.948747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629818ee-954b-468c-b84c-b1e9d8064b24 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:10.950112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e2f8c-3c9b-4b5a-8951-9af9daa63985 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:11.011252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:11.011826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.012119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.012434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] PATH_INFO: `/v3/projects/0beed92165a34e1badc0c090ec3d1aa3` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.014037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] RBAC: Authorizing `identity:get_project(project_id=0beed92165a34e1badc0c090ec3d1aa3)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:11.015524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:11.017200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 64/132] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:10 2022] GET /identity/v3/projects/0beed92165a34e1badc0c090ec3d1aa3 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:11.017947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:11.020259 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:11.020911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.021195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.021474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.022637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:11.024700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:11.026820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 69/133] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:10 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:11.027585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:11.134656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:11.155006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:11.164824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969b57d-492e-479f-90cc-eacf4b2f0fc4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:11.168525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8320-a68d-4c83-89bc-a93e03c6b1b4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:11.203164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:11.204210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.204761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.205568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/3e08281e8e384df6a2e274a09e73725b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.206113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229381c-7081-4a1d-b59c-62dcc97eba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:11.207228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229381c-7081-4a1d-b59c-62dcc97eba3d None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.207673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229381c-7081-4a1d-b59c-62dcc97eba3d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.208097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229381c-7081-4a1d-b59c-62dcc97eba3d None admin] PATH_INFO: `/v3/projects/0beed92165a34e1badc0c090ec3d1aa3/users/c72da6899dcd4aa896d76de5911a43ef/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.208420 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] RBAC: Authorizing `identity:create_grant(project_id=427bfb56dd934118aea1eaf475d0900a, user_id=3e08281e8e384df6a2e274a09e73725b, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:11.209977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:11.210762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229381c-7081-4a1d-b59c-62dcc97eba3d None admin] RBAC: Authorizing `identity:create_grant(project_id=0beed92165a34e1badc0c090ec3d1aa3, user_id=c72da6899dcd4aa896d76de5911a43ef, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:11.212403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229381c-7081-4a1d-b59c-62dcc97eba3d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:11.297446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 65/134] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:11 2022] PUT /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/3e08281e8e384df6a2e274a09e73725b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:11.299784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:11.329033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 70/135] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:11 2022] PUT /identity/v3/projects/0beed92165a34e1badc0c090ec3d1aa3/users/c72da6899dcd4aa896d76de5911a43ef/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:11.336410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02410f0c-9581-46ab-9dec-86c7c1f8c64e None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.337122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02410f0c-9581-46ab-9dec-86c7c1f8c64e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.337610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02410f0c-9581-46ab-9dec-86c7c1f8c64e None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.340107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 71/136] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:11.346499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03845-6383-4049-a95d-15d17a6a7e14 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.347793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03845-6383-4049-a95d-15d17a6a7e14 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.348367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f03845-6383-4049-a95d-15d17a6a7e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.384273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a2f03845-6383-4049-a95d-15d17a6a7e14 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:11.386269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a2f03845-6383-4049-a95d-15d17a6a7e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:11.494160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 72/137] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:11.497843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff5e5-79e5-49fa-a022-a64f10d91be0 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.498368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff5e5-79e5-49fa-a022-a64f10d91be0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.498848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff5e5-79e5-49fa-a022-a64f10d91be0 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.500823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 73/138] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:11.505970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369b67-521b-4750-9a0b-ee435da61084 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.506625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369b67-521b-4750-9a0b-ee435da61084 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.507105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6369b67-521b-4750-9a0b-ee435da61084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.520837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455f2d-32cd-40d0-8c1e-bb7f80434bab None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:11.534574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f6369b67-521b-4750-9a0b-ee435da61084 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:11.536955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f6369b67-521b-4750-9a0b-ee435da61084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:11.565004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:11.565622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.565873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.566163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.567390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:11.568965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:11.571289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 66/139] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:11 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:11.581402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:11.600613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:11.635012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 74/140] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:11.739852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61b623-25d2-4eff-8b4c-9bc47ab103a5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:11.782399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:11.783082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:11.783376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:11.783663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/c72da6899dcd4aa896d76de5911a43ef/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:11.786048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] RBAC: Authorizing `identity:create_grant(project_id=427bfb56dd934118aea1eaf475d0900a, user_id=c72da6899dcd4aa896d76de5911a43ef, role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:11.787464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:11.863701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 67/141] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:11 2022] PUT /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/c72da6899dcd4aa896d76de5911a43ef/roles/bde35a779ee4459c84bc6cc697de4145 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:11.957489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369b67-521b-4750-9a0b-ee435da61084 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:11.970336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:12.007655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:12.112587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:12.130102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6369b67-521b-4750-9a0b-ee435da61084 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:12.157828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46659f72-6a5f-4e43-86ab-019566390525 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:12.200103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:12.200787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:12.201071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:12.201364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:12.203092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:12.203739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:12.204026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:12.204334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:12.206422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:12.207905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:12.209702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 75/142] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:12.215757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:12.230326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:12.238049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:12.238890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:12.239664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 68/143] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:12.250932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:12.374750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:12.400834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43840b69-19f4-4474-8de5-be85cd5dbea2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:12.437553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:12.438277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:12.438574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:12.438857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:12.439573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:12.441245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:12.472316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74cce0-495c-4d4f-b929-72320959a947 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:12.499985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:12.516152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:12.516812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:12.517095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:12.517376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:12.518067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:12.518379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:12.519792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:12.530686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 69/144] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:12.536651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:12.551243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 76/145] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:12 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:12.685382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9269033-c8ce-4a5a-a6aa-e30615f965fb None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:12.727887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81217840-812e-410a-95e6-3793fd134192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:12.728568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217840-812e-410a-95e6-3793fd134192 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:12.728856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217840-812e-410a-95e6-3793fd134192 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:12.729136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81217840-812e-410a-95e6-3793fd134192 None admin] PATH_INFO: `/v3/users/839bab40fd4c472a9e9e323fbd7e1380` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:12.730384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217840-812e-410a-95e6-3793fd134192 None admin] RBAC: Authorizing `identity:get_user(user_id=839bab40fd4c472a9e9e323fbd7e1380)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:12.731867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81217840-812e-410a-95e6-3793fd134192 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:12.733505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 70/146] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:12 2022] GET /identity/v3/users/839bab40fd4c472a9e9e323fbd7e1380 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:12.739404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:12.872487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e892d9-f0dc-4f55-87f7-e874194df3ba None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:12.905378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:12.914367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9f16-4d28-4805-b1d7-a8deb3a9694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:12.915021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9f16-4d28-4805-b1d7-a8deb3a9694b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:12.915309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9f16-4d28-4805-b1d7-a8deb3a9694b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:12.915594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9f16-4d28-4805-b1d7-a8deb3a9694b None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:12.919582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9f16-4d28-4805-b1d7-a8deb3a9694b None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:12.919582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9f16-4d28-4805-b1d7-a8deb3a9694b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:12.920210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 77/147] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:12 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:12.925980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81217840-812e-410a-95e6-3793fd134192 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:12.995066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:13.044321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81217840-812e-410a-95e6-3793fd134192 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:13.049851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2966f-0f59-49c4-8b50-3f5e1eb64a72 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:13.050144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2966f-0f59-49c4-8b50-3f5e1eb64a72 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:13.050425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c2966f-0f59-49c4-8b50-3f5e1eb64a72 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:13.051776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 78/148] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:13.057950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908aa0-aae9-4ff7-afa6-8d0b07684b57 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:13.058245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908aa0-aae9-4ff7-afa6-8d0b07684b57 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:13.058528 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37908aa0-aae9-4ff7-afa6-8d0b07684b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:13.091416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-37908aa0-aae9-4ff7-afa6-8d0b07684b57 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:13.094136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-37908aa0-aae9-4ff7-afa6-8d0b07684b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:13.123504 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:13.124187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:13.124496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:13.124777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/839bab40fd4c472a9e9e323fbd7e1380/roles/5836edf91f934d0e97a25fc0e178c771` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:13.130765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] RBAC: Authorizing `identity:create_grant(project_id=427bfb56dd934118aea1eaf475d0900a, user_id=839bab40fd4c472a9e9e323fbd7e1380, role_id=5836edf91f934d0e97a25fc0e178c771)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:13.132331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:13.200136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 79/149] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:13.216329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 71/150] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:12 2022] PUT /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a/users/839bab40fd4c472a9e9e323fbd7e1380/roles/5836edf91f934d0e97a25fc0e178c771 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:13.552633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37908aa0-aae9-4ff7-afa6-8d0b07684b57 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:13.663361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37908aa0-aae9-4ff7-afa6-8d0b07684b57 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:13.699269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:13.705788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f302d9cc-2a52-4252-a705-c176053b67c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:13.706523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d9cc-2a52-4252-a705-c176053b67c4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:13.706810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d9cc-2a52-4252-a705-c176053b67c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:13.707140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f302d9cc-2a52-4252-a705-c176053b67c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:13.728377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f302d9cc-2a52-4252-a705-c176053b67c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-f302d9cc-2a52-4252-a705-c176053b67c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:13.733236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:13.735222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:13.737185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 80/151] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:13.740371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:13.863548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685b65-4f42-41db-b66f-3fc0ba77226a None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:13.863937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685b65-4f42-41db-b66f-3fc0ba77226a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:13.864113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b685b65-4f42-41db-b66f-3fc0ba77226a None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:13.865631 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 81/152] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:13.865797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801037e2-8fea-4e4f-b870-cc890e82c62c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:13.871285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a59fe-6be5-4813-b3c5-a14e7daadda3 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:13.871893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a59fe-6be5-4813-b3c5-a14e7daadda3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:13.872441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a59fe-6be5-4813-b3c5-a14e7daadda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:13.892787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a28a59fe-6be5-4813-b3c5-a14e7daadda3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:13.894301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a28a59fe-6be5-4813-b3c5-a14e7daadda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:13.898295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:13.929994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:13.930988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:13.931477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:13.931974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:13.932901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:13.933466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:13.935070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:13.955770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 72/153] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:13.962996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:14.038976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 82/154] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:14.122963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6f0a-1921-44aa-9e5e-9549651c4aaf None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:14.158817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:14.159745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:14.160230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:14.160691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:14.162024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:14.163678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:14.165504 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 73/155] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:13 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:14.171474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a59fe-6be5-4813-b3c5-a14e7daadda3 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:14.298851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a59fe-6be5-4813-b3c5-a14e7daadda3 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:14.322796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:14.347060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:14.347745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:14.348055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:14.348429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:14.427333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:14.428803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:14.548935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 83/156] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:14.549113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:14.554447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:14.583043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:14.645983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:14.686351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a7fab-a7ff-4c93-82f7-babc54e9153b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:14.725918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42270aff-c773-4749-8c24-95a3b7078e61 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:14.744922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:14.745589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:14.745879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:14.746158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:14.747358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:14.748910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:14.750741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 84/157] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:14 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:14.756278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:14.779675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:14.780354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:14.780647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:14.780929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:14.795895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:14.801275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:14.802203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:14.803730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 74/158] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:14.809109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:14.952668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:14.953024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc88c32-da9a-4a11-a402-8a53632209db None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:14.965098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:14.974512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe51e6-4b99-4ce2-b135-d9aee92d4f1a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:15.013878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a3b4e-7d29-44f3-a774-9846d2477be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:15.017482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3b4e-7d29-44f3-a774-9846d2477be7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.017482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3b4e-7d29-44f3-a774-9846d2477be7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.017482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a3b4e-7d29-44f3-a774-9846d2477be7 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.017482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a3b4e-7d29-44f3-a774-9846d2477be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:15.017482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a3b4e-7d29-44f3-a774-9846d2477be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:15.017482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a3b4e-7d29-44f3-a774-9846d2477be7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:15.032234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 75/159] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:15.033508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8b2a5-2720-4673-802f-1993f210117b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.033751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b60f5-5061-4569-abb0-2647605392d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:15.033914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8b2a5-2720-4673-802f-1993f210117b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.034106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8b2a5-2720-4673-802f-1993f210117b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.034380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b60f5-5061-4569-abb0-2647605392d8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.034667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b60f5-5061-4569-abb0-2647605392d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.034948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b60f5-5061-4569-abb0-2647605392d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.035307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 76/160] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:15.035949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b60f5-5061-4569-abb0-2647605392d8 None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=c72da6899dcd4aa896d76de5911a43ef) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:15.036340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b60f5-5061-4569-abb0-2647605392d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:15.037822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b60f5-5061-4569-abb0-2647605392d8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:15.041352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8b2a5-2720-4673-802f-1993f210117b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:15.049405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 85/161] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:14 2022] GET /identity/v3/role_assignments?user.id=c72da6899dcd4aa896d76de5911a43ef&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:15.062158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f350f48-b05f-4fdb-8384-5706515fb43c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.062451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f350f48-b05f-4fdb-8384-5706515fb43c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.062738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f350f48-b05f-4fdb-8384-5706515fb43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.097459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-1f350f48-b05f-4fdb-8384-5706515fb43c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:15.098794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1f350f48-b05f-4fdb-8384-5706515fb43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:15.209588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d8b2a5-2720-4673-802f-1993f210117b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:15.259512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 86/162] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:15.266346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e64a3b-9004-4295-997b-6723b55ec459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:15.267019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64a3b-9004-4295-997b-6723b55ec459 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.267306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64a3b-9004-4295-997b-6723b55ec459 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.267591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e64a3b-9004-4295-997b-6723b55ec459 None admin] PATH_INFO: `/v3/users/3e08281e8e384df6a2e274a09e73725b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.268789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e64a3b-9004-4295-997b-6723b55ec459 None admin] RBAC: Authorizing `identity:get_user(user_id=3e08281e8e384df6a2e274a09e73725b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:15.270271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e64a3b-9004-4295-997b-6723b55ec459 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:15.272014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 77/163] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:15 2022] GET /identity/v3/users/3e08281e8e384df6a2e274a09e73725b => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:15.278310 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f350f48-b05f-4fdb-8384-5706515fb43c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:15.420379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:15.444116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f350f48-b05f-4fdb-8384-5706515fb43c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:15.491688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:15.493220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.493705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.494159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.564786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:15.567001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:15.612479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce84f6-82b2-442e-b933-c14b16290c24 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.613426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce84f6-82b2-442e-b933-c14b16290c24 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.613901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce84f6-82b2-442e-b933-c14b16290c24 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.615514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 78/164] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:15.630357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8dc78-a6e1-4153-a399-53ee8ed5e26f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.630979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8dc78-a6e1-4153-a399-53ee8ed5e26f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.631459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8dc78-a6e1-4153-a399-53ee8ed5e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.669791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f2f8dc78-a6e1-4153-a399-53ee8ed5e26f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:15.671423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f2f8dc78-a6e1-4153-a399-53ee8ed5e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:15.676536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:15.696044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 87/165] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:15.705048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:15.733307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:15.819080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 79/166] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:15.819683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8dc78-a6e1-4153-a399-53ee8ed5e26f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:15.840325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99404a-3af4-4b12-9542-2003ec94e062 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:15.879088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:15.879742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:15.880033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:15.880364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:15.881516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:15.883781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:15.885697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 88/167] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:15 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:15.891299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:15.958009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:16.028096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595db10-9325-4b15-959e-52d94cff1af9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:16.077101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8dc78-a6e1-4153-a399-53ee8ed5e26f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:16.079395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:16.080023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.080336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.080618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.081356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=3e08281e8e384df6a2e274a09e73725b) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:16.081672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:16.083254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:16.097930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 89/168] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:15 2022] GET /identity/v3/role_assignments?user.id=3e08281e8e384df6a2e274a09e73725b&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:16.135976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:16.136670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.136958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.137243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.158374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:16.163301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:16.164960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:16.166391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 80/169] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:16.170904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:16.327579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e83ba-a384-4bf3-9336-e51d07305845 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:16.368346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:16.368990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.369282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.369571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.370280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:16.370598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:16.371116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:16.377862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:16.388464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 90/170] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:16.397296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:16.438677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:16.511996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:16.543199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab9dde-8254-44f5-a5ae-f7ed6ff91529 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:16.605846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:16.606873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.607460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.607938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.609451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:16.611117 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:16.613454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 81/171] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:16 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:16.619296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:16.658383 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df6dc0-edb6-4301-a5ae-82b3a98b3762 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:16.694543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:16.696047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.696498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.696946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.707613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:16.712872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:16.713801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:16.714586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:16.716494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 91/172] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:16.722368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:16.760164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:16.765559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:16.773634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1775e-4eee-45fd-82d4-48628787768e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:16.837934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887487a5-6245-47dc-8be2-52230feec65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:16.838737 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887487a5-6245-47dc-8be2-52230feec65c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.839119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887487a5-6245-47dc-8be2-52230feec65c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.839494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887487a5-6245-47dc-8be2-52230feec65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.853800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063fd9d-7334-4c38-bd7a-08c31dbef052 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:16.917551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34237805-8d70-4423-b7e3-caa231db03d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:16.918416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34237805-8d70-4423-b7e3-caa231db03d6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.918846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34237805-8d70-4423-b7e3-caa231db03d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.919261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34237805-8d70-4423-b7e3-caa231db03d6 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.920088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34237805-8d70-4423-b7e3-caa231db03d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:16.920559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34237805-8d70-4423-b7e3-caa231db03d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:16.922257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34237805-8d70-4423-b7e3-caa231db03d6 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:16.931348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 92/173] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:16.934714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865e2c-a541-49ba-912c-ae1c1cb13946 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:16.935160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865e2c-a541-49ba-912c-ae1c1cb13946 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:16.935585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3865e2c-a541-49ba-912c-ae1c1cb13946 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:16.937254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 93/174] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:16.941103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3865e2c-a541-49ba-912c-ae1c1cb13946 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:16.947741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887487a5-6245-47dc-8be2-52230feec65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:16.949265 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887487a5-6245-47dc-8be2-52230feec65c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:17.045164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:17.057812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 82/175] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:17.059087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cef5c-660c-49d7-ac31-68825da1fbba None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.059376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cef5c-660c-49d7-ac31-68825da1fbba None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.059656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cef5c-660c-49d7-ac31-68825da1fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.101758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f35cef5c-660c-49d7-ac31-68825da1fbba None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:17.103124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f35cef5c-660c-49d7-ac31-68825da1fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:17.133944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:17.139374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3865e2c-a541-49ba-912c-ae1c1cb13946 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:17.175284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d49a9-d1c3-4de2-85ea-0b641a58e4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:17.176113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 83/176] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:17.176492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d49a9-d1c3-4de2-85ea-0b641a58e4ee None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.176971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d49a9-d1c3-4de2-85ea-0b641a58e4ee None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.177095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cef5c-660c-49d7-ac31-68825da1fbba None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:17.177599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d49a9-d1c3-4de2-85ea-0b641a58e4ee None admin] PATH_INFO: `/v3/users/c72da6899dcd4aa896d76de5911a43ef` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.178952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d49a9-d1c3-4de2-85ea-0b641a58e4ee None admin] RBAC: Authorizing `identity:get_user(user_id=c72da6899dcd4aa896d76de5911a43ef)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:17.181178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d49a9-d1c3-4de2-85ea-0b641a58e4ee None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:17.183163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 94/177] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:16 2022] GET /identity/v3/users/c72da6899dcd4aa896d76de5911a43ef => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:17.189075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eba83-8252-4e4d-8cc0-ddea4df313fa None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.189606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eba83-8252-4e4d-8cc0-ddea4df313fa None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.190219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0eba83-8252-4e4d-8cc0-ddea4df313fa None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.191950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 95/178] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:17.197009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eba83-8252-4e4d-8cc0-ddea4df313fa None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:17.286372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cef5c-660c-49d7-ac31-68825da1fbba None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:17.310961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:17.315229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0eba83-8252-4e4d-8cc0-ddea4df313fa None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:17.322480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a3fbc-e570-4380-9b75-7343bdb97719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:17.323150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a3fbc-e570-4380-9b75-7343bdb97719 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.323441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a3fbc-e570-4380-9b75-7343bdb97719 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.323725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a3fbc-e570-4380-9b75-7343bdb97719 None admin] PATH_INFO: `/v3/projects/0beed92165a34e1badc0c090ec3d1aa3` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.325318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a3fbc-e570-4380-9b75-7343bdb97719 None admin] RBAC: Authorizing `identity:get_project(project_id=0beed92165a34e1badc0c090ec3d1aa3)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:17.326511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a3fbc-e570-4380-9b75-7343bdb97719 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:17.329318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 84/179] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:17 2022] GET /identity/v3/projects/0beed92165a34e1badc0c090ec3d1aa3 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:17.329722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508583b-df40-4b21-9f0b-2d5fd8e27c24 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.330008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508583b-df40-4b21-9f0b-2d5fd8e27c24 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.330288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508583b-df40-4b21-9f0b-2d5fd8e27c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.354598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5508583b-df40-4b21-9f0b-2d5fd8e27c24 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:17.355794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5508583b-df40-4b21-9f0b-2d5fd8e27c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:17.356467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c1a81-acda-467d-93fb-cb79e9375e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:17.357303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1a81-acda-467d-93fb-cb79e9375e0e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.357884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1a81-acda-467d-93fb-cb79e9375e0e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.358358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c1a81-acda-467d-93fb-cb79e9375e0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.398072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:17.432663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 85/180] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:17.436323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d44fb-4890-459f-a65d-4dcbccce75f8 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.436323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d44fb-4890-459f-a65d-4dcbccce75f8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.436323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d44fb-4890-459f-a65d-4dcbccce75f8 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.436323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 86/181] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:17.436323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d44fb-4890-459f-a65d-4dcbccce75f8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:17.440621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c1a81-acda-467d-93fb-cb79e9375e0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:17.442364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c1a81-acda-467d-93fb-cb79e9375e0e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:17.551867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d44fb-4890-459f-a65d-4dcbccce75f8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:17.576980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:17.582346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 96/182] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:17.583880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44349ec1-7384-4d07-91ad-529ebf5c8bcc None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.584360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44349ec1-7384-4d07-91ad-529ebf5c8bcc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.584803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44349ec1-7384-4d07-91ad-529ebf5c8bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.589945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:17.590772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.591225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.591675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.592645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=0beed92165a34e1badc0c090ec3d1aa3, user.id=c72da6899dcd4aa896d76de5911a43ef) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:17.593161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:17.594813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:17.601985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 87/183] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:17 2022] GET /identity/v3/role_assignments?user.id=c72da6899dcd4aa896d76de5911a43ef&scope.project.id=0beed92165a34e1badc0c090ec3d1aa3&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:17.603000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:17.604389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-44349ec1-7384-4d07-91ad-529ebf5c8bcc None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:17.605628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-44349ec1-7384-4d07-91ad-529ebf5c8bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:17.677953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 97/184] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:17.688375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44349ec1-7384-4d07-91ad-529ebf5c8bcc None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:17.692417 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:17.714368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31f5b5-80ca-454b-b0a2-9a8b75ae7000 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:17.761389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bf73a-8771-448a-bb35-e1de268a566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:17.762324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf73a-8771-448a-bb35-e1de268a566c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.762781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf73a-8771-448a-bb35-e1de268a566c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.763222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bf73a-8771-448a-bb35-e1de268a566c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.775243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bf73a-8771-448a-bb35-e1de268a566c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-af5bf73a-8771-448a-bb35-e1de268a566c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:17.781175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:17.782161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:17.782993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:17.785606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 88/185] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:17.787066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1e106-d08c-4a7a-92a0-e0fa3b73536c None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.787507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1e106-d08c-4a7a-92a0-e0fa3b73536c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.787940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1e106-d08c-4a7a-92a0-e0fa3b73536c None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.790024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 89/186] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:17.791402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1e106-d08c-4a7a-92a0-e0fa3b73536c None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:17.849499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:17.874855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44349ec1-7384-4d07-91ad-529ebf5c8bcc None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:17.910222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1e106-d08c-4a7a-92a0-e0fa3b73536c None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:17.921802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0f699-1aed-4f80-8cb7-5e7e1e17aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:17.922976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f699-1aed-4f80-8cb7-5e7e1e17aba0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.923326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f699-1aed-4f80-8cb7-5e7e1e17aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.923755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0f699-1aed-4f80-8cb7-5e7e1e17aba0 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.924921 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0f699-1aed-4f80-8cb7-5e7e1e17aba0 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:17.926610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0f699-1aed-4f80-8cb7-5e7e1e17aba0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:17.928717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 98/187] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:17 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:17.930626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192feb-b265-49ff-8c6c-0b41c2f9c537 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.930913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192feb-b265-49ff-8c6c-0b41c2f9c537 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.931186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c192feb-b265-49ff-8c6c-0b41c2f9c537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.949702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6c192feb-b265-49ff-8c6c-0b41c2f9c537 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:17.950043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:17.950661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:17.950830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6c192feb-b265-49ff-8c6c-0b41c2f9c537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:17.950931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:17.951243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:17.951888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:17.952220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:17.953627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:17.963624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 90/188] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:17.964923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.016104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.025416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 99/189] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:18.033548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192feb-b265-49ff-8c6c-0b41c2f9c537 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.074830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34f717-5c4a-44c2-9415-e9e0063a1f94 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.088738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.113427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.114064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.114348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.114629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.124719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:18.130478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:18.131480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:18.132390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 91/190] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:18.138019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.143064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c192feb-b265-49ff-8c6c-0b41c2f9c537 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.181471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.182085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.182395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.182679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.183405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] RBAC: Adding query filter params (role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=c72da6899dcd4aa896d76de5911a43ef) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:18.183714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.185201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.190953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 100/191] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/role_assignments?user.id=c72da6899dcd4aa896d76de5911a43ef&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:18.191718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.269919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825b41c-3b7b-43c5-9e2d-cc3c17817274 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.278400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.314864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.315602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.315888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.316160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] PATH_INFO: `/v3/users/6b6b51ae519745fda277e61bfcf0251c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.332162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=6b6b51ae519745fda277e61bfcf0251c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.333043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa0f1-5c37-498c-9bcd-5bc5a293ecbc None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.333660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.336335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 92/192] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/users/6b6b51ae519745fda277e61bfcf0251c => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:18.337343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.372167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.376008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.376681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.376969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.377254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.378388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.379840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.381635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 101/193] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:18.387241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.452356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb263b-16dc-4b31-b8de-62ad7cef7bd3 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.486542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.487148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.487247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179c2486-a086-4f5f-a48b-eaa82c9ccf36 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.487434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.487711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.488403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:18.488715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.490097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.497884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 93/194] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:18.503169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.511989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.524482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.524482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.524482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.524482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.532420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:18.537214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:18.538180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 102/195] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:18.539122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.590453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.601517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae6a22-2c72-434a-915a-700f75e66699 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.635384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.635997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.636314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.636601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.640152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b83782-4225-4507-a0e0-f4e8ef0fb446 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.672337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.672932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.673213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.673489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.674129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.675577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.702484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.703967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.781923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 103/196] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:18 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:18.782788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.795809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.814491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 94/197] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:18.815874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.839089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:18.898701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40b20e-b90a-496c-b297-b63b3ab77475 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.936411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9b193-71e6-4f6a-9f18-42adc81764a0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:18.939079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.939920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.940427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.940895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] PATH_INFO: `/v3/users/839bab40fd4c472a9e9e323fbd7e1380` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.945537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] RBAC: Authorizing `identity:get_user(user_id=839bab40fd4c472a9e9e323fbd7e1380)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.947027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.948841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 104/198] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/users/839bab40fd4c472a9e9e323fbd7e1380 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:18.949449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:18.981929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:18.982536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:18.982822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:18.983100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:18.983805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:18.984187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:18.986809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:18.996415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 95/199] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:18.997502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:19.067043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:19.077771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bfa75-6c42-49a9-a21b-8da969ecd487 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:19.092601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:19.119447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:19.119876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:19.120163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:19.120483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:19.121702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:19.123225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:19.124981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 105/200] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:19.125760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:19.137331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4aa24-27f7-4501-91d7-0df3dd781f64 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:19.175167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:19.175876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:19.176286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:19.176637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:19.249160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:19.250813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:19.255990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59679b-bad4-4076-985f-acd13c17a32f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:19.307260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:19.308169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:19.308484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:19.308769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] PATH_INFO: `/v3/users/6b6b51ae519745fda277e61bfcf0251c` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:19.309920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:19.311316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] RBAC: Authorizing `identity:get_user(user_id=6b6b51ae519745fda277e61bfcf0251c)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:19.312879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:19.323572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 106/201] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:19 2022] GET /identity/v3/users/6b6b51ae519745fda277e61bfcf0251c => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:19.323572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:19.370013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 96/202] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:19.371174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:19.381626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:19.446135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3bc91-568b-4fb9-9bcb-bb60abb3a759 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:19.482876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:19.483592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:19.483886 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:19.484174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:19.484583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1178e3-3fc4-4f18-9211-8daf1b187b49 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:19.485242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=6b6b51ae519745fda277e61bfcf0251c) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:19.485559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:19.487244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:19.494013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 107/203] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:19 2022] GET /identity/v3/role_assignments?user.id=6b6b51ae519745fda277e61bfcf0251c&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:19.495027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:19.535230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:19.535873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:19.536156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:19.536456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:19.576013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:19.661560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1325-a468-45ea-9edc-a8cef6eda3de None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:19.679806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:19.683437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:19.685697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:19.715887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:19.716583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:19.716879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:19.717169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:19.718343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:19.719906 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:19.721816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 108/204] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:19 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:19.728202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:19.839224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341928a6-e5c5-4f91-9554-1f8ffbb85425 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:19.874638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:19.875258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:19.875546 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:19.875830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:19.876661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] RBAC: Adding query filter params (role.id=5836edf91f934d0e97a25fc0e178c771, scope.project.id=427bfb56dd934118aea1eaf475d0900a, user.id=839bab40fd4c472a9e9e323fbd7e1380) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:19.877336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:19.878823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:19.885648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 109/205] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:19 2022] GET /identity/v3/role_assignments?user.id=839bab40fd4c472a9e9e323fbd7e1380&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=5836edf91f934d0e97a25fc0e178c771 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:19.970505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 97/206] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:19.976792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:20.045582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:20.108621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154cc8f-ec92-415a-a91a-f5fb65d748fa None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:20.144112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71780e28-f137-4ee8-91f3-3891ba2ee90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:20.144787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780e28-f137-4ee8-91f3-3891ba2ee90a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:20.145076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780e28-f137-4ee8-91f3-3891ba2ee90a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:20.145359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71780e28-f137-4ee8-91f3-3891ba2ee90a None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:20.146519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71780e28-f137-4ee8-91f3-3891ba2ee90a None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:20.148018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71780e28-f137-4ee8-91f3-3891ba2ee90a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:20.150004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 110/207] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:19 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:20.156012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:20.223726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:20.281736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d0918-2e7c-4ec9-87b3-6b38133c7712 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:20.327263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d2a5e-1cad-48f3-898d-41941b56f2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:20.327969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2a5e-1cad-48f3-898d-41941b56f2e9 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:20.328287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2a5e-1cad-48f3-898d-41941b56f2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:20.328566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d2a5e-1cad-48f3-898d-41941b56f2e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:20.329305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2a5e-1cad-48f3-898d-41941b56f2e9 None admin] RBAC: Adding query filter params (role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=6b6b51ae519745fda277e61bfcf0251c) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:20.329619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2a5e-1cad-48f3-898d-41941b56f2e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:20.331080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d2a5e-1cad-48f3-898d-41941b56f2e9 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:20.338017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 98/208] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:20 2022] GET /identity/v3/role_assignments?user.id=6b6b51ae519745fda277e61bfcf0251c&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:20.921697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647fa4d-348d-45aa-8320-b6cd257ac0a3 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:20.922244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647fa4d-348d-45aa-8320-b6cd257ac0a3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:20.922244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647fa4d-348d-45aa-8320-b6cd257ac0a3 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:20.923610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 111/209] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:20.929043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373f4ca-29ca-4d0d-b352-ff5fc9a32a03 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:20.929853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373f4ca-29ca-4d0d-b352-ff5fc9a32a03 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:20.930137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373f4ca-29ca-4d0d-b352-ff5fc9a32a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:20.949031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b373f4ca-29ca-4d0d-b352-ff5fc9a32a03 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:20.950244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b373f4ca-29ca-4d0d-b352-ff5fc9a32a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:21.020361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 99/210] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:21.108060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd064-1b99-4a25-a7b9-b93382ece761 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.108405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd064-1b99-4a25-a7b9-b93382ece761 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.108697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbd064-1b99-4a25-a7b9-b93382ece761 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.110055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 112/211] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:21.115335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d336-d6f2-4c81-982a-e65f4baa72d3 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.115626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d336-d6f2-4c81-982a-e65f4baa72d3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.115909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916d336-d6f2-4c81-982a-e65f4baa72d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.134976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-7916d336-d6f2-4c81-982a-e65f4baa72d3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:21.136163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7916d336-d6f2-4c81-982a-e65f4baa72d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:21.176873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:21.204299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 100/212] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:21.296308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbd064-1b99-4a25-a7b9-b93382ece761 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:21.407471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbd064-1b99-4a25-a7b9-b93382ece761 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:21.418419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:21.443645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:21.444241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.444535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.444852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.456628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:21.461654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:21.462517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:21.463311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 113/213] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:21.468835 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d336-d6f2-4c81-982a-e65f4baa72d3 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:21.481165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:21.585175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f17e7c1-cd53-4c35-84a7-28bd4c6014eb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:21.592585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916d336-d6f2-4c81-982a-e65f4baa72d3 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:21.622658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d529ce-4483-49ae-8991-d14c47b1556b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:21.623291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d529ce-4483-49ae-8991-d14c47b1556b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.623586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d529ce-4483-49ae-8991-d14c47b1556b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.624013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d529ce-4483-49ae-8991-d14c47b1556b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.625098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d529ce-4483-49ae-8991-d14c47b1556b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:21.626565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d529ce-4483-49ae-8991-d14c47b1556b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:21.631653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b5976-de41-4e94-b8fa-d3a67308425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:21.632324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b5976-de41-4e94-b8fa-d3a67308425b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.632567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 114/214] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:21.632675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b5976-de41-4e94-b8fa-d3a67308425b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.632886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b5976-de41-4e94-b8fa-d3a67308425b None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.633562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b5976-de41-4e94-b8fa-d3a67308425b None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:21.633755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100a137-fd99-4293-b96a-7d27e718dc19 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.633906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b5976-de41-4e94-b8fa-d3a67308425b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:21.634051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100a137-fd99-4293-b96a-7d27e718dc19 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.634326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100a137-fd99-4293-b96a-7d27e718dc19 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.635238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b5976-de41-4e94-b8fa-d3a67308425b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:21.639725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 115/215] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:21.639725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100a137-fd99-4293-b96a-7d27e718dc19 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:21.647244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 101/216] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:21.649416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04fa3-060c-4726-859e-17c80e832d49 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.649776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04fa3-060c-4726-859e-17c80e832d49 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.650125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec04fa3-060c-4726-859e-17c80e832d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.668901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-7ec04fa3-060c-4726-859e-17c80e832d49 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:21.670063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7ec04fa3-060c-4726-859e-17c80e832d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:21.684465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:21.701702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:21.742737 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 102/217] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:21.746717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100a137-fd99-4293-b96a-7d27e718dc19 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:21.749176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04fa3-060c-4726-859e-17c80e832d49 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:21.785639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:21.785639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.787527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.787527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.788060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:21.790187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:21.859263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec04fa3-060c-4726-859e-17c80e832d49 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:21.895777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 116/218] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:21 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:31:21.896291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:21.897206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:21.897674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:21.898722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] PATH_INFO: `/v3/users/2f24d74b0fbb4ca3aff2e350b075fca6` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:21.915827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] RBAC: Authorizing `identity:get_user(user_id=2f24d74b0fbb4ca3aff2e350b075fca6)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:21.917803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:21.919863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 103/219] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:21 2022] GET /identity/v3/users/2f24d74b0fbb4ca3aff2e350b075fca6 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:21.926285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.018710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.037720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.050022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f66e5c-5551-44f5-81a3-9a29c8e4ab54 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.058275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.091965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8e39-1443-4042-b090-e4681ddef7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:22.092672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8e39-1443-4042-b090-e4681ddef7be None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.092899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8e39-1443-4042-b090-e4681ddef7be None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.093184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8e39-1443-4042-b090-e4681ddef7be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.152171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec2df4-44cf-4e73-972f-6e938ece1fcf None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.192720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8e39-1443-4042-b090-e4681ddef7be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:22.194213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8e39-1443-4042-b090-e4681ddef7be None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:22.197440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:22.199199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.199711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.200187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.215514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:22.222279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:22.226442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:22.227230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 104/220] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:22.232980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.324708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.326085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.338437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 117/221] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:22.339734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc464d-fdd4-4f3a-9f31-1c40027a0f9a None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.340037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc464d-fdd4-4f3a-9f31-1c40027a0f9a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.340345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc464d-fdd4-4f3a-9f31-1c40027a0f9a None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.341842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 118/222] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:22.343829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc464d-fdd4-4f3a-9f31-1c40027a0f9a None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.349889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87774eb3-b2ac-45b3-b859-2b7d016cbaf7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.386322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68cecc-cbdb-44c2-9c61-0c4083b1261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:22.387081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68cecc-cbdb-44c2-9c61-0c4083b1261b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.387367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68cecc-cbdb-44c2-9c61-0c4083b1261b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.387766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68cecc-cbdb-44c2-9c61-0c4083b1261b None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.396119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68cecc-cbdb-44c2-9c61-0c4083b1261b None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:22.396119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68cecc-cbdb-44c2-9c61-0c4083b1261b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:22.396119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68cecc-cbdb-44c2-9c61-0c4083b1261b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:22.399949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 105/223] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:22.401402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9546-3819-4fe7-a6b3-ca934a77b819 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.401693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9546-3819-4fe7-a6b3-ca934a77b819 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.401970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9546-3819-4fe7-a6b3-ca934a77b819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.420984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8e1e9546-3819-4fe7-a6b3-ca934a77b819 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:22.422190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8e1e9546-3819-4fe7-a6b3-ca934a77b819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:22.455999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc464d-fdd4-4f3a-9f31-1c40027a0f9a None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.492369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:22.493008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.493288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.493561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.494693 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:22.495023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 106/224] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:22.495880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e9546-3819-4fe7-a6b3-ca934a77b819 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.496413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:22.498397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 119/225] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:22.509156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.581113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.622497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a39615-f107-4d29-abdf-52b7cc8de36d None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.661913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:22.685130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:22.685750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.686032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.686316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.687059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=2f24d74b0fbb4ca3aff2e350b075fca6) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:22.687369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:22.689663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:22.694132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e9546-3819-4fe7-a6b3-ca934a77b819 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.700012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 120/226] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/role_assignments?user.id=2f24d74b0fbb4ca3aff2e350b075fca6&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:22.748331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:22.748979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.749266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.749548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] PATH_INFO: `/v3/users/6b6b51ae519745fda277e61bfcf0251c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.750687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] RBAC: Authorizing `identity:get_user(user_id=6b6b51ae519745fda277e61bfcf0251c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:22.752144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:22.753818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 107/227] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/users/6b6b51ae519745fda277e61bfcf0251c => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:22.759384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.830404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:22.936401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e4ef-e7b2-4375-b5cd-3cd57d8e7eea None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.938735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79035a-1117-4afa-83a9-f94fcbbe1083 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:22.973076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:22.973842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:22.974128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:22.974402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:22.985525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:22.990292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:22.991239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:22.992158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 108/228] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:22.997302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:23.003541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:23.008548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:23.017539 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:23.018187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:23.022688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:23.022688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:23.022688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:23.022688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:23.028454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 121/229] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:23.030250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:23.105165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7f6d4-4ced-46ff-b97d-6fd0f512f59d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:23.140590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:23.141228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:23.141508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:23.141783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:23.142457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:23.142764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:23.144142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:23.153278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 109/230] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:23.158664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:23.199071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97d46a-ef48-4429-9ddf-5112470a9ae6 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:23.263015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:23.263688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:23.263969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:23.264270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/6b6b51ae519745fda277e61bfcf0251c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:23.268450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a1603a8a0d44aacb128e690e2aebfe7, user_id=6b6b51ae519745fda277e61bfcf0251c, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:23.269908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:23.283506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:23.321833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5752263-ee4b-4895-9207-01282201a13f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:23.350835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 122/231] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:23 2022] PUT /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/6b6b51ae519745fda277e61bfcf0251c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:23.356445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:23.357106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:23.357388 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:23.357667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] PATH_INFO: `/v3/users/6b6b51ae519745fda277e61bfcf0251c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:23.358888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] RBAC: Authorizing `identity:get_user(user_id=6b6b51ae519745fda277e61bfcf0251c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:23.360506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:23.362555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 110/232] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:23 2022] GET /identity/v3/users/6b6b51ae519745fda277e61bfcf0251c => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:23.368872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:23.457437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:23.511335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d12ab7-8d4b-4cf8-acd0-9456ce313b39 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:23.547892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cbd94-7de9-4dfc-ace1-62460732a62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:23.548560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cbd94-7de9-4dfc-ace1-62460732a62a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:23.548840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cbd94-7de9-4dfc-ace1-62460732a62a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:23.549114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cbd94-7de9-4dfc-ace1-62460732a62a None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:23.550240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cbd94-7de9-4dfc-ace1-62460732a62a None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:23.551695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cbd94-7de9-4dfc-ace1-62460732a62a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:23.553365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 123/233] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:23 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:23.559765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:23.674641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4d8b7-7d8a-4924-b5f5-35404d526285 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:23.718060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba977c-1b3f-4348-a28f-832d8830da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:23.718646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba977c-1b3f-4348-a28f-832d8830da44 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:23.718929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba977c-1b3f-4348-a28f-832d8830da44 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:23.719205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba977c-1b3f-4348-a28f-832d8830da44 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/6b6b51ae519745fda277e61bfcf0251c/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:23.721438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba977c-1b3f-4348-a28f-832d8830da44 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a1603a8a0d44aacb128e690e2aebfe7, user_id=6b6b51ae519745fda277e61bfcf0251c, role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:23.722883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba977c-1b3f-4348-a28f-832d8830da44 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:23.727520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:23.840542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 111/234] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:23 2022] PUT /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/6b6b51ae519745fda277e61bfcf0251c/roles/bde35a779ee4459c84bc6cc697de4145 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:24.332335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aba61-5f34-4507-af3a-81e1dd28c66d None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:24.332873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aba61-5f34-4507-af3a-81e1dd28c66d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:24.332873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013aba61-5f34-4507-af3a-81e1dd28c66d None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:24.334546 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 124/235] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:24.340218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a368f-d4f8-4cba-bc49-bf483483b345 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:24.340634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a368f-d4f8-4cba-bc49-bf483483b345 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:24.340827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a368f-d4f8-4cba-bc49-bf483483b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:24.365616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-771a368f-d4f8-4cba-bc49-bf483483b345 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:24.367701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-771a368f-d4f8-4cba-bc49-bf483483b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:24.437361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5c75d-c3d5-416e-937f-5bcaa271b3b8 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:24.437675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5c75d-c3d5-416e-937f-5bcaa271b3b8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:24.437916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5c75d-c3d5-416e-937f-5bcaa271b3b8 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:24.443133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 125/236] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:24.444692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7888ee8-e20a-451f-9c57-0c5a3919edec None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:24.444984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7888ee8-e20a-451f-9c57-0c5a3919edec None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:24.445620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7888ee8-e20a-451f-9c57-0c5a3919edec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:24.470711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 112/237] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:24.474656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a7888ee8-e20a-451f-9c57-0c5a3919edec None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:24.476394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a7888ee8-e20a-451f-9c57-0c5a3919edec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:24.543713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 126/238] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:24.856460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a368f-d4f8-4cba-bc49-bf483483b345 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:24.967243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a368f-d4f8-4cba-bc49-bf483483b345 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:24.973457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7888ee8-e20a-451f-9c57-0c5a3919edec None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:25.012738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:25.016538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:25.017172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.017454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.017729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.028913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:25.034215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:25.038110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:25.039465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 113/239] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:25.044949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:25.140212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:25.151751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a564a-6096-41d1-a548-18cf4bd293bb None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:25.188308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:25.188919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.189198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.189473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.190146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] RBAC: Adding query filter params (name=reader) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:25.191019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:25.196225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:25.202587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 114/240] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:25.208415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:25.263618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:25.282365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7888ee8-e20a-451f-9c57-0c5a3919edec None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:25.332913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a592b-6e16-488f-b9e3-a3a5b164100d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:25.370484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad728286-9817-4ff4-9bbc-5fca25b69f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:25.371893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728286-9817-4ff4-9bbc-5fca25b69f3a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.372551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728286-9817-4ff4-9bbc-5fca25b69f3a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.373106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad728286-9817-4ff4-9bbc-5fca25b69f3a None admin] PATH_INFO: `/v3/users/875f2578f40a414c91ff14c7ed4a54c0` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.390089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728286-9817-4ff4-9bbc-5fca25b69f3a None admin] RBAC: Authorizing `identity:get_user(user_id=875f2578f40a414c91ff14c7ed4a54c0)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:25.392057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad728286-9817-4ff4-9bbc-5fca25b69f3a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:25.399516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 115/241] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:25 2022] GET /identity/v3/users/875f2578f40a414c91ff14c7ed4a54c0 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:25.399516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed049-01f4-48ad-be0e-aa77df6e18f0 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.399516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed049-01f4-48ad-be0e-aa77df6e18f0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.399516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ed049-01f4-48ad-be0e-aa77df6e18f0 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.400550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 116/242] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:25.401654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed049-01f4-48ad-be0e-aa77df6e18f0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:25.404783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661df14-83cc-4b55-83e7-0c7aa7bd05b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:25.406279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661df14-83cc-4b55-83e7-0c7aa7bd05b3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.406759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661df14-83cc-4b55-83e7-0c7aa7bd05b3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.407250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661df14-83cc-4b55-83e7-0c7aa7bd05b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.409778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661df14-83cc-4b55-83e7-0c7aa7bd05b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:25.411432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661df14-83cc-4b55-83e7-0c7aa7bd05b3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:25.413297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 127/243] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:25.415159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528bf05-152d-42dd-b002-dbf49f3ff5bb None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.415668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528bf05-152d-42dd-b002-dbf49f3ff5bb None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.416486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528bf05-152d-42dd-b002-dbf49f3ff5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.439940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9528bf05-152d-42dd-b002-dbf49f3ff5bb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:25.441563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9528bf05-152d-42dd-b002-dbf49f3ff5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:25.521654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ed049-01f4-48ad-be0e-aa77df6e18f0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:25.525175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:25.526292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 128/244] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:25.527279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528bf05-152d-42dd-b002-dbf49f3ff5bb None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:25.588625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:25.616096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:25.617386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.617743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.618095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.634301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528bf05-152d-42dd-b002-dbf49f3ff5bb None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:25.671646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825022-41b0-4d31-b987-a762542109db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:25.672664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825022-41b0-4d31-b987-a762542109db None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:25.673168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825022-41b0-4d31-b987-a762542109db None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:25.673712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825022-41b0-4d31-b987-a762542109db None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:25.674569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825022-41b0-4d31-b987-a762542109db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:25.676224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09825022-41b0-4d31-b987-a762542109db None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:25.725224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:25.727679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:25.768094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 129/245] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:25 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:25.853994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 117/246] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:25.855780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825022-41b0-4d31-b987-a762542109db None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:25.879679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:25.884877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:25.990210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09825022-41b0-4d31-b987-a762542109db None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:25.999292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:26.027862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec81401-3241-4e85-aa01-53aeed61c960 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:26.029611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea62a5f7-e665-4dbc-99d4-53dfdca2c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:26.030264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a5f7-e665-4dbc-99d4-53dfdca2c21e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.030553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a5f7-e665-4dbc-99d4-53dfdca2c21e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.030832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea62a5f7-e665-4dbc-99d4-53dfdca2c21e None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.031995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a5f7-e665-4dbc-99d4-53dfdca2c21e None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:26.034581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea62a5f7-e665-4dbc-99d4-53dfdca2c21e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:26.035532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 130/247] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:25 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:26.036821 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17252-ca5a-4b86-977c-8afa48e3abe8 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.037178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17252-ca5a-4b86-977c-8afa48e3abe8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.037473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a17252-ca5a-4b86-977c-8afa48e3abe8 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.038733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 131/248] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:26.043771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17252-ca5a-4b86-977c-8afa48e3abe8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:26.070781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bf937-1572-43c5-9bd0-c9766214945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:26.071766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf937-1572-43c5-9bd0-c9766214945b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.072304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf937-1572-43c5-9bd0-c9766214945b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.072836 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bf937-1572-43c5-9bd0-c9766214945b None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.086819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bf937-1572-43c5-9bd0-c9766214945b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-2e9bf937-1572-43c5-9bd0-c9766214945b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:26.092448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:26.093406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:26.094223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 118/249] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:26.094878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126656-9020-4274-8337-7330ab51263b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.095119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126656-9020-4274-8337-7330ab51263b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.095403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31126656-9020-4274-8337-7330ab51263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.116977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-31126656-9020-4274-8337-7330ab51263b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:26.118164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-31126656-9020-4274-8337-7330ab51263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:26.175568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a17252-ca5a-4b86-977c-8afa48e3abe8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:26.192846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:26.202747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 119/250] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:26.203616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126656-9020-4274-8337-7330ab51263b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:26.222234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856d8b1-c978-4932-82f6-c0e88f69b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:26.223037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d8b1-c978-4932-82f6-c0e88f69b91d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.223313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d8b1-c978-4932-82f6-c0e88f69b91d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.224049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856d8b1-c978-4932-82f6-c0e88f69b91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.230221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d8b1-c978-4932-82f6-c0e88f69b91d None admin] RBAC: Adding query filter params (role.id=5836edf91f934d0e97a25fc0e178c771, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=875f2578f40a414c91ff14c7ed4a54c0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:26.230221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d8b1-c978-4932-82f6-c0e88f69b91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:26.230221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856d8b1-c978-4932-82f6-c0e88f69b91d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:26.234718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 132/251] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:26 2022] GET /identity/v3/role_assignments?user.id=875f2578f40a414c91ff14c7ed4a54c0&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=5836edf91f934d0e97a25fc0e178c771 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:26.248054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821eb5-e50f-4e86-9129-efafa700af00 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.248638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821eb5-e50f-4e86-9129-efafa700af00 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.248923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88821eb5-e50f-4e86-9129-efafa700af00 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.250282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 133/252] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:26.258331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be992e-459f-4cf5-b63e-771edd4998bb None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.258612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be992e-459f-4cf5-b63e-771edd4998bb None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.261888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be992e-459f-4cf5-b63e-771edd4998bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.291191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-18be992e-459f-4cf5-b63e-771edd4998bb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:26.297018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-18be992e-459f-4cf5-b63e-771edd4998bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:26.367426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:26.397636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31126656-9020-4274-8337-7330ab51263b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:26.427216 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 134/253] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:26.445220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:26.445840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.446126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.446412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.447097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:26.447412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:26.448844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:26.457550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 120/254] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:26.463437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be992e-459f-4cf5-b63e-771edd4998bb None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:26.524499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:26.617938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:26.620161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be992e-459f-4cf5-b63e-771edd4998bb None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:26.700878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:26.701531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.701817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.702093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] PATH_INFO: `/v3/users/2f24d74b0fbb4ca3aff2e350b075fca6` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.703932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] RBAC: Authorizing `identity:get_user(user_id=2f24d74b0fbb4ca3aff2e350b075fca6)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:26.705475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:26.707809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 135/255] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:26 2022] GET /identity/v3/users/2f24d74b0fbb4ca3aff2e350b075fca6 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:26.713730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:26.720399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c13e7-04cc-4faa-95f7-8d29c1dbbf14 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:26.755708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:26.778951 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:26.779512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.779793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.780066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.800853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:26.806780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:26.807697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:26.809013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 121/256] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:26.817143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:26.873085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494e019-8936-4a53-ac8d-aa7b675d5bff None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:26.939995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:26.940678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:26.940958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:26.941228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:26.942382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:26.943816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:26.953793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 136/257] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:26 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:26.954532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:26.982303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eae197-0277-4133-b8c6-97f1c8023f96 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.000547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:27.020314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.021267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.021553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.021973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.023218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:27.023528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:27.025085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:27.034757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 122/258] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:27.035536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:27.146229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965c48-3c52-4bbc-8ad4-c7933b627b6c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.173678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a840e-7db7-432b-bbd2-6712bb142f28 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.176529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:27.205981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.206653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.206940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.207222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/2f24d74b0fbb4ca3aff2e350b075fca6/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.213007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a1603a8a0d44aacb128e690e2aebfe7, user_id=2f24d74b0fbb4ca3aff2e350b075fca6, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:27.214478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:27.233095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.233738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.234026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.234311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.244982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:27.249771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:27.250630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 137/259] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:27.251997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:27.320999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 123/260] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:27 2022] PUT /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/2f24d74b0fbb4ca3aff2e350b075fca6/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:27.322252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:27.371476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:27.456477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6676b2-8c3b-40f6-a713-d684a5863410 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.465634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c573d-4bba-49a5-ba2b-761327119cea None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.504545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.505149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.505435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.505717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] PATH_INFO: `/v3/users/6b6b51ae519745fda277e61bfcf0251c` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.507474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] RBAC: Authorizing `identity:get_user(user_id=6b6b51ae519745fda277e61bfcf0251c)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:27.509326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:27.514995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 138/261] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:27 2022] GET /identity/v3/users/6b6b51ae519745fda277e61bfcf0251c => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:27.516363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:27.520849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.521779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.522285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.523357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.524278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:27.524807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:27.526411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:27.540352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 124/262] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:27.545905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:27.558376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:27.631481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d8ab2-0ae0-4325-b67d-d767abfd17cf None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.668807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.671151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.671151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.671151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.706156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bbfcf-957a-407e-8f78-9150b99c324a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.720544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:27.745143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.745777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.745884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:27.746051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.746330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] PATH_INFO: `/v3/users/6b6b51ae519745fda277e61bfcf0251c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.747547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:27.747652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] RBAC: Authorizing `identity:get_user(user_id=6b6b51ae519745fda277e61bfcf0251c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:27.749022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:27.750815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 125/263] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:27 2022] GET /identity/v3/users/6b6b51ae519745fda277e61bfcf0251c => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:27.756635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:27.779690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:27.855547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 139/264] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:27.861124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:27.865308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2a115-fd83-4ae8-a09e-5070c9aaee3a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.901528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:27.902175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:27.902462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:27.902911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:27.965696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046acaed-3f6e-4ddd-8a02-acab917c1061 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:27.966360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:28.000681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:28.001520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:28.002382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.002767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.003184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.004501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:28.005524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:28.006171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:28.007657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:28.008945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 140/265] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:27 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:28.014866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:28.130148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 126/266] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:28.137436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:28.172834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c22c52-a823-47ec-8aef-bceb61b29fd8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:28.231284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:28.232302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.232956 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.233533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.234705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=6b6b51ae519745fda277e61bfcf0251c) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:28.235214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:28.236870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:28.249643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 141/267] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:28 2022] GET /identity/v3/role_assignments?user.id=6b6b51ae519745fda277e61bfcf0251c&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:28.265874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:28.329550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d7f387-8047-437d-a5e5-89cd22d9dd14 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:28.381291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf1ba2-bd02-47a2-bd19-1c334781f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:28.382415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf1ba2-bd02-47a2-bd19-1c334781f09b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.382650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf1ba2-bd02-47a2-bd19-1c334781f09b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.382928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf1ba2-bd02-47a2-bd19-1c334781f09b None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.384112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf1ba2-bd02-47a2-bd19-1c334781f09b None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:28.385624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf1ba2-bd02-47a2-bd19-1c334781f09b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:28.387691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 127/268] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:28 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:28.393418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:28.490220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:28.542208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d372f-69cb-4fe7-9b76-c1f4b5944cc7 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:28.582057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab9c8d-cad2-41bb-b9a0-d561eaf3bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:28.582665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9c8d-cad2-41bb-b9a0-d561eaf3bc5a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.583038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9c8d-cad2-41bb-b9a0-d561eaf3bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.583318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab9c8d-cad2-41bb-b9a0-d561eaf3bc5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.584051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab9c8d-cad2-41bb-b9a0-d561eaf3bc5a None admin] RBAC: Adding query filter params (role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=6b6b51ae519745fda277e61bfcf0251c) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:28.584420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab9c8d-cad2-41bb-b9a0-d561eaf3bc5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:28.586160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab9c8d-cad2-41bb-b9a0-d561eaf3bc5a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:28.592020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 142/269] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:28 2022] GET /identity/v3/role_assignments?user.id=6b6b51ae519745fda277e61bfcf0251c&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:28.883418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f8d3-50d1-455a-9fa3-da2b139bcb9a None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.883916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f8d3-50d1-455a-9fa3-da2b139bcb9a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.883990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f8d3-50d1-455a-9fa3-da2b139bcb9a None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.885331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 128/270] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:28.890831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fa7c8-901c-4c9f-8214-41993ed4cd60 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.891133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fa7c8-901c-4c9f-8214-41993ed4cd60 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.891422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05fa7c8-901c-4c9f-8214-41993ed4cd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.905354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13478d-796c-4261-81f0-6a06e5711203 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.905641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13478d-796c-4261-81f0-6a06e5711203 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.905921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13478d-796c-4261-81f0-6a06e5711203 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.907271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 129/271] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:28.912789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5254-959c-49ee-9be0-25571fb48208 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:28.913643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5254-959c-49ee-9be0-25571fb48208 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:28.913880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5254-959c-49ee-9be0-25571fb48208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:28.917573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c05fa7c8-901c-4c9f-8214-41993ed4cd60 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:28.918996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c05fa7c8-901c-4c9f-8214-41993ed4cd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:28.942903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-570b5254-959c-49ee-9be0-25571fb48208 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:28.944119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-570b5254-959c-49ee-9be0-25571fb48208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:29.036715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 143/272] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:29.045455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 130/273] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:29.165860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b945396-c918-4227-8974-ded85f6ddfb0 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.166454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b945396-c918-4227-8974-ded85f6ddfb0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.166926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b945396-c918-4227-8974-ded85f6ddfb0 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.168749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 144/274] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:29.177714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd96f-ca36-4061-8979-921a9964a2a1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.178245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd96f-ca36-4061-8979-921a9964a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.179336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0cd96f-ca36-4061-8979-921a9964a2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.197630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-9a0cd96f-ca36-4061-8979-921a9964a2a1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:29.199067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9a0cd96f-ca36-4061-8979-921a9964a2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:29.260013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:29.267783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 131/275] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:29.313231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b945396-c918-4227-8974-ded85f6ddfb0 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.327055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd96f-ca36-4061-8979-921a9964a2a1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.380934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:29.427655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b945396-c918-4227-8974-ded85f6ddfb0 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.431496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0cd96f-ca36-4061-8979-921a9964a2a1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.465455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771d46a-debd-400e-903b-29358383c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.466432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771d46a-debd-400e-903b-29358383c33a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.466890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771d46a-debd-400e-903b-29358383c33a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.467414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771d46a-debd-400e-903b-29358383c33a None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.467759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.468419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.468703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.468977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.480562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771d46a-debd-400e-903b-29358383c33a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:29.480742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:29.485622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:29.486688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:29.487686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 132/276] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-5771d46a-debd-400e-903b-29358383c33a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:29.489000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:29.489995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:29.491272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:29.493111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 145/277] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:29.497651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.498811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771d46a-debd-400e-903b-29358383c33a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.559355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:29.604707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771d46a-debd-400e-903b-29358383c33a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.614518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f71e03-db50-4629-8f0b-7ea73fc201b7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.622373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:29.639527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.640129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.640438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.640714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.641455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:29.641759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:29.643183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:29.651827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 146/278] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:29.656572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.656572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.656572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.656572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.656832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] RBAC: Adding query filter params (name=reader) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:29.656832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:29.656832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:29.658240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.664911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 133/279] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:29.670061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.759251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6ce8-df50-43d0-8782-67ac19faadeb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.773885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c35789b-4588-4d8f-98c4-396e1babc86a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.791863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:29.795031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.795849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.796137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.796453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.797581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:29.799177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:29.805751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 147/280] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:29.805751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.814145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.814942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.815223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.815494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] PATH_INFO: `/v3/users/f8845ee0f2a149f3b560ba93391f38e1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.830190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f8845ee0f2a149f3b560ba93391f38e1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:29.831895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:29.833901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 134/281] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/users/f8845ee0f2a149f3b560ba93391f38e1 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:29.834821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.860318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:29.910294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb198f4-94a1-45fa-bd9b-347668338685 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.934014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb397e6-a998-4c71-8efe-facc257855f9 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:29.943145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.943774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.944066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.944408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] PATH_INFO: `/v3/users/875f2578f40a414c91ff14c7ed4a54c0` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.945540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] RBAC: Authorizing `identity:get_user(user_id=875f2578f40a414c91ff14c7ed4a54c0)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:29.946984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:29.953113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 148/282] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/users/875f2578f40a414c91ff14c7ed4a54c0 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:29.953113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:29.968822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99c5ae-267b-411c-a57e-fe3f386bb41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:29.969433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c5ae-267b-411c-a57e-fe3f386bb41c None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:29.969716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c5ae-267b-411c-a57e-fe3f386bb41c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:29.970006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99c5ae-267b-411c-a57e-fe3f386bb41c None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:29.970663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99c5ae-267b-411c-a57e-fe3f386bb41c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:29.972137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99c5ae-267b-411c-a57e-fe3f386bb41c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:30.047844 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44498e65-2d36-43f9-96d0-56d163ec2722 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:30.062915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:30.080029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dd5ab-3195-4f37-9e0c-50522defe7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:30.080658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd5ab-3195-4f37-9e0c-50522defe7d1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:30.080944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd5ab-3195-4f37-9e0c-50522defe7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:30.081226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dd5ab-3195-4f37-9e0c-50522defe7d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:30.081471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 135/283] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:29 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:30.081955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dd5ab-3195-4f37-9e0c-50522defe7d1 None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, user.id=f8845ee0f2a149f3b560ba93391f38e1, scope.system=all) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:30.082307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dd5ab-3195-4f37-9e0c-50522defe7d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:30.082761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9312-b18a-47c8-a9ac-e86f2eaf903a None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:30.083054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9312-b18a-47c8-a9ac-e86f2eaf903a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:30.083336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f9312-b18a-47c8-a9ac-e86f2eaf903a None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:30.083765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dd5ab-3195-4f37-9e0c-50522defe7d1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:30.084755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 136/284] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:30.089286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9312-b18a-47c8-a9ac-e86f2eaf903a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:30.090456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 149/285] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Aug 22 05:31:29 2022] GET /identity/v3/role_assignments?user.id=f8845ee0f2a149f3b560ba93391f38e1&scope.system=all&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:30.091808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c494c2-38cf-493e-a41c-ff9a3d1b50b9 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:30.092139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c494c2-38cf-493e-a41c-ff9a3d1b50b9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:30.092506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c494c2-38cf-493e-a41c-ff9a3d1b50b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:30.115550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-77c494c2-38cf-493e-a41c-ff9a3d1b50b9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:30.117006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-77c494c2-38cf-493e-a41c-ff9a3d1b50b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:30.153925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:30.205627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 150/286] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:30.240649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f9312-b18a-47c8-a9ac-e86f2eaf903a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:30.279502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:30.280317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:30.280629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:30.280988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:30.282196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:30.283839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:30.285941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 137/287] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:30 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:30.292141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c494c2-38cf-493e-a41c-ff9a3d1b50b9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:30.400934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c494c2-38cf-493e-a41c-ff9a3d1b50b9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:30.412915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:30.437055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:30.437757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:30.438047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:30.438332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/875f2578f40a414c91ff14c7ed4a54c0/roles/5836edf91f934d0e97a25fc0e178c771` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:30.440309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a1603a8a0d44aacb128e690e2aebfe7, user_id=875f2578f40a414c91ff14c7ed4a54c0, role_id=5836edf91f934d0e97a25fc0e178c771)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:30.441817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:30.492033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:30.507333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 151/288] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:31:30 2022] PUT /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/users/875f2578f40a414c91ff14c7ed4a54c0/roles/5836edf91f934d0e97a25fc0e178c771 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:30.607976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:30.611220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43deb39a-310f-4759-a3ac-3a10aed420b8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:30.656559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:30.657132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:30.657417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:30.657693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:30.672240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:30.677063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:30.677958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:30.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 138/289] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:30.686249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:30.801072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2e2c2-f9e9-476d-bf76-858afc49f024 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:30.837782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:30.838765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:30.839257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:30.839737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:30.840634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:30.841146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:30.842733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:30.852471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 152/290] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:30.858811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:31.005097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8595f7-af9a-4049-8bcf-1153a01ec5a2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:31.053809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:31.054448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:31.054733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:31.055013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] PATH_INFO: `/v3/users/2f24d74b0fbb4ca3aff2e350b075fca6` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:31.056254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] RBAC: Authorizing `identity:get_user(user_id=2f24d74b0fbb4ca3aff2e350b075fca6)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:31.058082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:31.059673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 139/291] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:30 2022] GET /identity/v3/users/2f24d74b0fbb4ca3aff2e350b075fca6 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:31.065852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:31.113752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:31.191494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec16865-5caf-4fc8-8dcf-0234dd7ec390 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:31.227443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:31.228071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:31.228385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:31.228660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:31.300415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:31.301982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:31.332121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:31.400965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 153/292] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:31.409278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:31.466653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:31.569125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdfba5-6387-4827-87ec-05d5b11f44ac None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:31.613345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708a11f-dce0-4bd2-91e3-9b4f78df1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:31.613995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a11f-dce0-4bd2-91e3-9b4f78df1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:31.614281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a11f-dce0-4bd2-91e3-9b4f78df1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:31.614561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708a11f-dce0-4bd2-91e3-9b4f78df1ab0 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:31.621308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708a11f-dce0-4bd2-91e3-9b4f78df1ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:31.622833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708a11f-dce0-4bd2-91e3-9b4f78df1ab0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:31.624825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 140/293] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:31 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:31.630595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:31.757898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82b8b3-d78a-44a9-98d8-ad61fad4ec51 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:31.788948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:31.792661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbe6a2-7c71-4060-bc6e-24b5299fb7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:31.793268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe6a2-7c71-4060-bc6e-24b5299fb7a8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:31.793551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe6a2-7c71-4060-bc6e-24b5299fb7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:31.793826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbe6a2-7c71-4060-bc6e-24b5299fb7a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:31.794562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbe6a2-7c71-4060-bc6e-24b5299fb7a8 None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=2f24d74b0fbb4ca3aff2e350b075fca6) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:31.794873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbe6a2-7c71-4060-bc6e-24b5299fb7a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:31.796387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbe6a2-7c71-4060-bc6e-24b5299fb7a8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:31.806410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 154/294] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:31 2022] GET /identity/v3/role_assignments?user.id=2f24d74b0fbb4ca3aff2e350b075fca6&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:32.124581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c1224-d006-4432-a0ab-eac755089765 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.125105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c1224-d006-4432-a0ab-eac755089765 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.125212 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c1224-d006-4432-a0ab-eac755089765 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.126716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 141/295] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:32.132775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ef97-1705-4972-950a-b9c862faaacf None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.133064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ef97-1705-4972-950a-b9c862faaacf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.133346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394ef97-1705-4972-950a-b9c862faaacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.153995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4394ef97-1705-4972-950a-b9c862faaacf None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:32.155176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4394ef97-1705-4972-950a-b9c862faaacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:32.232136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 155/296] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:32.530882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c1224-d006-4432-a0ab-eac755089765 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:32.627314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c310f-d4dd-43da-be99-02ccdccd3b01 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.627657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c310f-d4dd-43da-be99-02ccdccd3b01 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.627875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43c310f-d4dd-43da-be99-02ccdccd3b01 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.629189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:32.633650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 156/297] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:32.634907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8726d47-cf46-48b6-ab1f-27f3c57cb091 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.635194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8726d47-cf46-48b6-ab1f-27f3c57cb091 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.635469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8726d47-cf46-48b6-ab1f-27f3c57cb091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.641224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c1224-d006-4432-a0ab-eac755089765 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:32.658793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c8726d47-cf46-48b6-ab1f-27f3c57cb091 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:32.660539 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c8726d47-cf46-48b6-ab1f-27f3c57cb091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:32.684366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:32.685006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.685290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.685569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.697389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:32.702967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:32.703875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:32.705053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 142/298] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:32.710899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:32.754982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 157/299] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:32.822160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b9b3f-6bbd-468b-b7b8-b0f5bd2f45c5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:32.857248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417464c3-1d1f-4271-b286-aefa9568a553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:32.857869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417464c3-1d1f-4271-b286-aefa9568a553 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.858207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417464c3-1d1f-4271-b286-aefa9568a553 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.858487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417464c3-1d1f-4271-b286-aefa9568a553 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.859162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417464c3-1d1f-4271-b286-aefa9568a553 None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:32.859511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417464c3-1d1f-4271-b286-aefa9568a553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:32.861028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417464c3-1d1f-4271-b286-aefa9568a553 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:32.869754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 143/300] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:32.875280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8726d47-cf46-48b6-ab1f-27f3c57cb091 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:32.899308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45804a7-f64e-4b33-a133-c59231c595fa None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.899637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45804a7-f64e-4b33-a133-c59231c595fa None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.899865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45804a7-f64e-4b33-a133-c59231c595fa None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.901496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 144/301] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:32.907509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3cc8e-1bf9-4ee8-b445-ad3a92fe6ed1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:32.908048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3cc8e-1bf9-4ee8-b445-ad3a92fe6ed1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:32.908358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3cc8e-1bf9-4ee8-b445-ad3a92fe6ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:32.933261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-dae3cc8e-1bf9-4ee8-b445-ad3a92fe6ed1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:32.935137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-dae3cc8e-1bf9-4ee8-b445-ad3a92fe6ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:32.941572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:32.953937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:32.986324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8726d47-cf46-48b6-ab1f-27f3c57cb091 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.021408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 145/302] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:33.023033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.023671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.023951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.024247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] PATH_INFO: `/v3/users/f8845ee0f2a149f3b560ba93391f38e1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.025426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f8845ee0f2a149f3b560ba93391f38e1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.026870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.032874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 158/303] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:32 2022] GET /identity/v3/users/f8845ee0f2a149f3b560ba93391f38e1 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:33.033413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c635f5d-7dc3-46c3-ba22-6d571a942ab0 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.033700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c635f5d-7dc3-46c3-ba22-6d571a942ab0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.033978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c635f5d-7dc3-46c3-ba22-6d571a942ab0 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.034605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.035440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 146/304] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:33.041283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22fa9-6017-4b69-81b0-303c9479a5f2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.041567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22fa9-6017-4b69-81b0-303c9479a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.041845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c22fa9-6017-4b69-81b0-303c9479a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.059480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-41c22fa9-6017-4b69-81b0-303c9479a5f2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:33.060755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-41c22fa9-6017-4b69-81b0-303c9479a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:33.136496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 147/305] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:33.137219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c22fa9-6017-4b69-81b0-303c9479a5f2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.144500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168a258-8832-44d0-8593-2d1b2cb1c1b0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.171127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:33.182080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.183089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.183533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.190619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] PATH_INFO: `/v3/system/users/f8845ee0f2a149f3b560ba93391f38e1/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.190619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f8845ee0f2a149f3b560ba93391f38e1, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.190619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.223861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:33.244836 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c22fa9-6017-4b69-81b0-303c9479a5f2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.277623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.278256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.278539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.278812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.296968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:33.301725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:33.302875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:33.304071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:33.304738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 159/306] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Aug 22 05:31:33 2022] PUT /identity/v3/system/users/f8845ee0f2a149f3b560ba93391f38e1/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:33.304738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.306268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 148/307] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:33.312128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.427786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44fad7-0d70-4397-b73c-e641a98aafcd None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.427969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c2ce9-d359-461e-8cee-9a9213ad11f9 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.466874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.467512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.467795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.468071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.476511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.477313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.477756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.478153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:33.478315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.479115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:33.479560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.481167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:33.484225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:33.485130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:33.485929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 160/308] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:33.486581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.488492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:33.494318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 149/309] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:33.495349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.543255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:33.596763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8512497-2646-40ca-bf74-9b33e58ee7f5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.601584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3599a-87db-4514-9e4a-816ffbf1b299 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.634019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.634712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.634936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.635217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.636369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.637744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.637857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.638351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.638633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.638908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.639563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 161/310] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:33.639670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:33.639946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.640153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.641451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.650136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 150/311] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:33.650843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.712669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:33.755619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c3bf94-5299-4468-914c-fa559870d151 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.757129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efce25-2090-485b-b4ab-be71850d4612 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.772978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:33.791981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.792780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.793113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.793335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] PATH_INFO: `/v3/users/a257cb685758482da60ad9f6d80d42e2` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.793708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c317293-b138-489b-ae96-876f21017030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.794316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317293-b138-489b-ae96-876f21017030 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.794598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317293-b138-489b-ae96-876f21017030 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.794871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317293-b138-489b-ae96-876f21017030 None admin] PATH_INFO: `/v3/groups` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.795499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c317293-b138-489b-ae96-876f21017030 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.796967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c317293-b138-489b-ae96-876f21017030 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.807062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] RBAC: Authorizing `identity:get_user(user_id=a257cb685758482da60ad9f6d80d42e2)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.808840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.810979 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 162/312] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/users/a257cb685758482da60ad9f6d80d42e2 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:33.811947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.856222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 151/313] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Aug 22 05:31:33 2022] POST /identity/v3/groups => generated 229 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:33.856222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c317293-b138-489b-ae96-876f21017030 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:33.929787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829379c2-4797-4dc7-8f34-b39ab8a6cdb2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:33.970112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:33.970699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:33.971016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:33.971378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] PATH_INFO: `/v3/users/875f2578f40a414c91ff14c7ed4a54c0` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:33.972692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] RBAC: Authorizing `identity:get_user(user_id=875f2578f40a414c91ff14c7ed4a54c0)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:33.974180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:33.976539 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 163/314] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/users/875f2578f40a414c91ff14c7ed4a54c0 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:33.982418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:34.024771 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c317293-b138-489b-ae96-876f21017030 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:34.034052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:34.054356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:34.065952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:34.066979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:34.067789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:34.067789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:34.070894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] RBAC: Adding query filter params (role.id=5836edf91f934d0e97a25fc0e178c771, user.id=a257cb685758482da60ad9f6d80d42e2, scope.system=all) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:34.070894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:34.070894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:34.076281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 152/315] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/role_assignments?user.id=a257cb685758482da60ad9f6d80d42e2&scope.system=all&role.id=5836edf91f934d0e97a25fc0e178c771 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:34.115019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff38be0-71b4-49b4-b1a7-a08d83fcd447 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:34.153912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:34.154545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:34.154832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:34.155115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:34.231184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:34.232714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:34.278082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:34.342030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 164/316] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:34.347866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:34.459531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c17c4-e8c1-4ca4-b7e2-b18687274ec4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:34.494633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79291cc8-f34d-4308-bf0c-cc765a0c723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:34.495188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79291cc8-f34d-4308-bf0c-cc765a0c723a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:34.495475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79291cc8-f34d-4308-bf0c-cc765a0c723a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:34.495757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79291cc8-f34d-4308-bf0c-cc765a0c723a None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:34.496932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79291cc8-f34d-4308-bf0c-cc765a0c723a None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:34.498376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79291cc8-f34d-4308-bf0c-cc765a0c723a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:34.500330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 153/317] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:34 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:34.506097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:34.609329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dca9b3-1257-4a0d-a766-7ec7851abb42 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:34.645285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afc7d8-8feb-40c8-9544-e32f4ae98e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:34.646692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc7d8-8feb-40c8-9544-e32f4ae98e84 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:34.647730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc7d8-8feb-40c8-9544-e32f4ae98e84 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:34.648227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afc7d8-8feb-40c8-9544-e32f4ae98e84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:34.649187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afc7d8-8feb-40c8-9544-e32f4ae98e84 None admin] RBAC: Adding query filter params (role.id=5836edf91f934d0e97a25fc0e178c771, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7, user.id=875f2578f40a414c91ff14c7ed4a54c0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:34.649701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afc7d8-8feb-40c8-9544-e32f4ae98e84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:34.651376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afc7d8-8feb-40c8-9544-e32f4ae98e84 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:34.658125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 165/318] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:31:34 2022] GET /identity/v3/role_assignments?user.id=875f2578f40a414c91ff14c7ed4a54c0&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=5836edf91f934d0e97a25fc0e178c771 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:35.242995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151eea6-f4b2-458e-b15f-e5a23b882141 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:35.243395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151eea6-f4b2-458e-b15f-e5a23b882141 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:35.243567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151eea6-f4b2-458e-b15f-e5a23b882141 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:35.245084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 154/319] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:35.250093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95a99-097c-45f7-bcc9-5a7cd87227a4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:35.250387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95a99-097c-45f7-bcc9-5a7cd87227a4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:35.250668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e95a99-097c-45f7-bcc9-5a7cd87227a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:35.346810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:35.353034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-36e95a99-097c-45f7-bcc9-5a7cd87227a4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:35.354219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-36e95a99-097c-45f7-bcc9-5a7cd87227a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:35.420534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 166/320] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:35.682766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151eea6-f4b2-458e-b15f-e5a23b882141 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:35.739344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:35.784901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151eea6-f4b2-458e-b15f-e5a23b882141 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:35.817218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6ba33e-f505-474c-bd82-eed2a2017cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:35.817841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba33e-f505-474c-bd82-eed2a2017cdc None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:35.818120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba33e-f505-474c-bd82-eed2a2017cdc None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:35.818398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ba33e-f505-474c-bd82-eed2a2017cdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:35.829030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6ba33e-f505-474c-bd82-eed2a2017cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-ac6ba33e-f505-474c-bd82-eed2a2017cdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:35.834135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:35.835953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:35.836794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:35.840489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 155/321] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:35.841812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95a99-097c-45f7-bcc9-5a7cd87227a4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:35.919591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e701-f1ed-4caf-b509-ce05c7490036 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:35.919930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e701-f1ed-4caf-b509-ce05c7490036 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:35.920149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69e701-f1ed-4caf-b509-ce05c7490036 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:35.921670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 156/322] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:35.926359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f397b-f6b2-46ea-8449-dc7bb78d6339 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:35.926650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f397b-f6b2-46ea-8449-dc7bb78d6339 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:35.926932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f397b-f6b2-46ea-8449-dc7bb78d6339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:35.945891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-363f397b-f6b2-46ea-8449-dc7bb78d6339 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:35.946046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e95a99-097c-45f7-bcc9-5a7cd87227a4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:35.946986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-363f397b-f6b2-46ea-8449-dc7bb78d6339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:35.981265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:35.981869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:35.982155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:35.982437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:35.983772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:35.983772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:35.984804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:35.987329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:35.998965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 167/323] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:36.000140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.028236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 157/324] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:36.058256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365156a2-e74f-4b0b-9850-608123f1ceab None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.058552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365156a2-e74f-4b0b-9850-608123f1ceab None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.058844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365156a2-e74f-4b0b-9850-608123f1ceab None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.060186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 158/325] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:36.064927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351fafd-807d-46a2-ad5b-23de1f98d3f2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.065219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351fafd-807d-46a2-ad5b-23de1f98d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.065505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351fafd-807d-46a2-ad5b-23de1f98d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.083459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-7351fafd-807d-46a2-ad5b-23de1f98d3f2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:36.084695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7351fafd-807d-46a2-ad5b-23de1f98d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:36.100140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8419-5afb-4b00-a081-d486dca5c4a2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:36.124126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:36.135794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:36.136457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.136741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.137012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] PATH_INFO: `/v3/users/f8845ee0f2a149f3b560ba93391f38e1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.138138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] RBAC: Authorizing `identity:get_user(user_id=f8845ee0f2a149f3b560ba93391f38e1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:36.139560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:36.141202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 168/326] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:35 2022] GET /identity/v3/users/f8845ee0f2a149f3b560ba93391f38e1 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:36.147052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.156457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 159/327] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:36.214778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:36.248091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18246422-18bc-4973-b612-66ae9e08a36a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:36.281134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:36.281740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.282019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.282287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.283063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] RBAC: Adding query filter params (role.id=6ba30e1147874694ad926bff7dd0bfc9, user.id=f8845ee0f2a149f3b560ba93391f38e1, scope.system=all) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:36.286890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:36.286890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:36.287110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351fafd-807d-46a2-ad5b-23de1f98d3f2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.302899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 169/328] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Aug 22 05:31:36 2022] GET /identity/v3/role_assignments?user.id=f8845ee0f2a149f3b560ba93391f38e1&scope.system=all&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:36.395834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351fafd-807d-46a2-ad5b-23de1f98d3f2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:36.422901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.434226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:36.434873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.435157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.435684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.436573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:36.438041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:36.439629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 160/329] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:36.445101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.492080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:36.535209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79698851-eba5-4755-8a0e-52f1ccc9448d None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:36.548828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6c26-e5a6-4419-b1cb-636f816dfa4b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:36.558822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:36.569038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:36.569665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.569950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.570256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.579937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:36.582303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:36.582886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.583171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.583452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] PATH_INFO: `/v3/groups` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.584078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:36.585085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:36.586226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:36.587024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:36.587631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:36.587705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 170/330] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:36.592272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.687039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 161/331] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Aug 22 05:31:36 2022] POST /identity/v3/groups => generated 226 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:31:36.689399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f923c-28b8-4ec6-8c81-3ab1ccc16b4d None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:36.727052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:36.727676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.727962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.728273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.728970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:36.729285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:36.730730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:36.740320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 171/332] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:36.746049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.848042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5758-7770-4ce5-a562-37669b0c545c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:36.849683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:36.883178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531f404-1218-478e-83be-0422a4ed6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:36.883814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531f404-1218-478e-83be-0422a4ed6f52 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:36.884101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531f404-1218-478e-83be-0422a4ed6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:36.884410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531f404-1218-478e-83be-0422a4ed6f52 None admin] PATH_INFO: `/v3/users/a257cb685758482da60ad9f6d80d42e2` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:36.885563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531f404-1218-478e-83be-0422a4ed6f52 None admin] RBAC: Authorizing `identity:get_user(user_id=a257cb685758482da60ad9f6d80d42e2)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:36.887024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531f404-1218-478e-83be-0422a4ed6f52 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:36.888644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 162/333] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:36 2022] GET /identity/v3/users/a257cb685758482da60ad9f6d80d42e2 => generated 293 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:36.894440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:36.949115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:37.004070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a103c-50c7-48c0-98bf-18e95efec7fc None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:37.038570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef596f71-6b27-4962-ac76-0ee7d48e7a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:37.039251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596f71-6b27-4962-ac76-0ee7d48e7a04 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:37.039538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596f71-6b27-4962-ac76-0ee7d48e7a04 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:37.039816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef596f71-6b27-4962-ac76-0ee7d48e7a04 None admin] PATH_INFO: `/v3/system/users/a257cb685758482da60ad9f6d80d42e2/roles/5836edf91f934d0e97a25fc0e178c771` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:37.041278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef596f71-6b27-4962-ac76-0ee7d48e7a04 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a257cb685758482da60ad9f6d80d42e2, role_id=5836edf91f934d0e97a25fc0e178c771)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:37.042661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef596f71-6b27-4962-ac76-0ee7d48e7a04 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:37.111504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 172/334] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Aug 22 05:31:36 2022] PUT /identity/v3/system/users/a257cb685758482da60ad9f6d80d42e2/roles/5836edf91f934d0e97a25fc0e178c771 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:39.216837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16e8ef-5195-4281-b7d9-6a40a8ac769b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.217414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16e8ef-5195-4281-b7d9-6a40a8ac769b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.217414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16e8ef-5195-4281-b7d9-6a40a8ac769b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.218983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 163/335] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:39.230080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e32510-019f-44bf-b807-d575420f1d04 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.230545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e32510-019f-44bf-b807-d575420f1d04 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.230720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e32510-019f-44bf-b807-d575420f1d04 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.234812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 173/336] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:39.237573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2571a-4d07-4f20-8578-f13ae82791b5 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.237870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2571a-4d07-4f20-8578-f13ae82791b5 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.238155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2571a-4d07-4f20-8578-f13ae82791b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.248677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4fe3c-7ddc-4a03-883a-aa7468057089 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.248962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4fe3c-7ddc-4a03-883a-aa7468057089 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.249240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4fe3c-7ddc-4a03-883a-aa7468057089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.280476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-aae2571a-4d07-4f20-8578-f13ae82791b5 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:39.281765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-aae2571a-4d07-4f20-8578-f13ae82791b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:39.295218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-10e4fe3c-7ddc-4a03-883a-aa7468057089 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:39.302452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-10e4fe3c-7ddc-4a03-883a-aa7468057089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:39.420864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 164/337] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:39.422577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf2d5-fdba-461b-a126-6dc1dfdd29a7 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.423071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf2d5-fdba-461b-a126-6dc1dfdd29a7 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.423603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbf2d5-fdba-461b-a126-6dc1dfdd29a7 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.429185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 165/338] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:39.430441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edda14-88f2-4b11-b00e-5bf6e8b5397c None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.430915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edda14-88f2-4b11-b00e-5bf6e8b5397c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.431372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edda14-88f2-4b11-b00e-5bf6e8b5397c None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.432795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 166/339] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:39.435158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001f0e-59e5-4476-a962-adbfc7f904ca None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.435634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001f0e-59e5-4476-a962-adbfc7f904ca None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.436095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001f0e-59e5-4476-a962-adbfc7f904ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.448517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 174/340] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:39.449112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692c9f5-50bb-4636-933e-240faaf8e5f4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.449407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692c9f5-50bb-4636-933e-240faaf8e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.449711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692c9f5-50bb-4636-933e-240faaf8e5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.457374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5b001f0e-59e5-4476-a962-adbfc7f904ca None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:39.458799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5b001f0e-59e5-4476-a962-adbfc7f904ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:39.486682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5692c9f5-50bb-4636-933e-240faaf8e5f4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:39.486682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5692c9f5-50bb-4636-933e-240faaf8e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:39.534732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 167/341] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:39.562027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:39.585861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 175/342] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:39.815428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b001f0e-59e5-4476-a962-adbfc7f904ca None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:39.832914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692c9f5-50bb-4636-933e-240faaf8e5f4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:39.851543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:39.930950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b001f0e-59e5-4476-a962-adbfc7f904ca None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:39.969677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:39.970663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:39.971153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:39.971681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:39.983845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:39.989745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:39.991174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:39.991979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:39.992648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692c9f5-50bb-4636-933e-240faaf8e5f4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:39.994886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 168/343] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:40.000974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.086486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.087226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.087446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.087734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.111539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:40.121163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:40.123322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d246f-0f87-4e2e-a66e-c54e553e488e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:40.129640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:40.130555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:40.131893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 176/344] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:40.136491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.174548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.175768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.176297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.176787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.177658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:40.178252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:40.179923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:40.181094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:40.192166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 169/345] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:40.193368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.258516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f853e6-e851-42ad-9dc7-19b20d9c6c48 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.306038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fde57-6ac4-46be-b957-699ad7de6af0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.308904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.310085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.310085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.310085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.325574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:40.330537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:40.331430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 177/346] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:40.332967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.348434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.349116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.349493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.349900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.351589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:40.351589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:40.352744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:40.364217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 170/347] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:40.364217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.392385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:40.444520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:40.460736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b12ed0-1626-48e3-9b34-2abb6a94133e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.478396 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f37b2-5211-4a78-9e82-f8eadfba75d4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.510582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.511397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.511687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.511968 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.514944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.515802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.516324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.516796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.532994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:40.539545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:40.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:40.541392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:40.544093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 178/348] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:40.545511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.599612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:40.601159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:40.618087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:40.697876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32599d7-0db3-40a1-a121-9ec6a47e75d5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.714289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 171/349] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:40.715146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.747536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.748440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.748730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.749012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.750143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:40.750480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:40.752170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:40.765294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 179/350] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:40.766289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.793731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:40.854620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c39f60-d80b-4461-8578-609772553fb0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.877178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:40.906922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726146b-4f68-466b-96c4-4b689a91772b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:40.907605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.908565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.909114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.909610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] PATH_INFO: `/v3/users/a257cb685758482da60ad9f6d80d42e2` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.911016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] RBAC: Authorizing `identity:get_user(user_id=a257cb685758482da60ad9f6d80d42e2)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:40.912750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:40.914869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 172/351] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/users/a257cb685758482da60ad9f6d80d42e2 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:40.915913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:40.951239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:40.951869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:40.952155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:40.952472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:40.953155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:40.953469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:40.955067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:40.966544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 180/352] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:40.967664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:41.042350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a5c2cf-d494-4808-8980-a67edc436bee None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.062397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.083482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df05d1-f349-46a3-a4b7-5f163799416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:41.084150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df05d1-f349-46a3-a4b7-5f163799416d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.085001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df05d1-f349-46a3-a4b7-5f163799416d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.085529 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df05d1-f349-46a3-a4b7-5f163799416d None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.086699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df05d1-f349-46a3-a4b7-5f163799416d None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:41.088145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df05d1-f349-46a3-a4b7-5f163799416d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:41.090235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 173/353] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:41.091413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1ae73-6c2a-462c-9bdc-4eaa6b58b1db None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.091682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0010a3-8fca-47c5-bfde-219f1a629e9c None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.091971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0010a3-8fca-47c5-bfde-219f1a629e9c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.092432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0010a3-8fca-47c5-bfde-219f1a629e9c None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.093668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 174/354] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:41.094428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0010a3-8fca-47c5-bfde-219f1a629e9c None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:41.136290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470707e-c236-4745-a737-214572494a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:41.136863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470707e-c236-4745-a737-214572494a33 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.137149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470707e-c236-4745-a737-214572494a33 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.137432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470707e-c236-4745-a737-214572494a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.155705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.220141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470707e-c236-4745-a737-214572494a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:41.221661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470707e-c236-4745-a737-214572494a33 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:41.223321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0010a3-8fca-47c5-bfde-219f1a629e9c None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.261023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:41.262422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.262422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.262422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.263015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] RBAC: Adding query filter params (role.id=5836edf91f934d0e97a25fc0e178c771, user.id=a257cb685758482da60ad9f6d80d42e2, scope.system=all) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:41.263327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:41.264899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:41.279144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 175/355] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Aug 22 05:31:41 2022] GET /identity/v3/role_assignments?user.id=a257cb685758482da60ad9f6d80d42e2&scope.system=all&role.id=5836edf91f934d0e97a25fc0e178c771 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:41.280025 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:41.321145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.367946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 181/356] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:41.369723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49a6b-6605-4084-903e-ad29965dcda5 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.370227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49a6b-6605-4084-903e-ad29965dcda5 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.370709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da49a6b-6605-4084-903e-ad29965dcda5 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.372556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 182/357] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:41.373524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da49a6b-6605-4084-903e-ad29965dcda5 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:41.434264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f50f7b-b93c-4fa2-b17e-4941d8e641ab None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.445736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.473051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:41.473664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.473951 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.474231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.516560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da49a6b-6605-4084-903e-ad29965dcda5 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.555537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000f5f9-2b17-4f03-bc03-13a6780994ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:41.556178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f5f9-2b17-4f03-bc03-13a6780994ad None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.557124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f5f9-2b17-4f03-bc03-13a6780994ad None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.557124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000f5f9-2b17-4f03-bc03-13a6780994ad None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.559146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:41.560835 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:41.565179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000f5f9-2b17-4f03-bc03-13a6780994ad None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:41.567614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000f5f9-2b17-4f03-bc03-13a6780994ad None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:41.569469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 183/358] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:41 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:41.570064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af340-c8ef-4647-baf4-213033747ce2 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.571193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af340-c8ef-4647-baf4-213033747ce2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.571193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67af340-c8ef-4647-baf4-213033747ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.590760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b67af340-c8ef-4647-baf4-213033747ce2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:41.591946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b67af340-c8ef-4647-baf4-213033747ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:41.628656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.673129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 184/359] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:41.674373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9ba9-6b14-4407-a097-b943b451d27c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.674673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9ba9-6b14-4407-a097-b943b451d27c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.674940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd9ba9-6b14-4407-a097-b943b451d27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.690637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 176/360] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:41.691788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:41.702559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.706278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c5bd9ba9-6b14-4407-a097-b943b451d27c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:41.707610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c5bd9ba9-6b14-4407-a097-b943b451d27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:41.798476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 185/361] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:41.799740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd9ba9-6b14-4407-a097-b943b451d27c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:41.822515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c5561-37da-4c79-9503-5477c56d0763 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.859377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:41.859995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.860311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.860585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.861706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:41.863187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:41.864989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 177/362] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:41 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:41.865688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:41.931995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.938531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd9ba9-6b14-4407-a097-b943b451d27c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.961750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:41.982386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:41.983001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:41.983282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:41.983561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:41.984730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=427bfb56dd934118aea1eaf475d0900a) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:41.984730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:41.986047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:41.990929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1402213-e4e8-4122-b99b-c0cf547c6200 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:41.998220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 186/363] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:41 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:41.999047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.029736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.030419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.030708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.030982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.032242 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:42.033718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:42.035440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 178/364] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:41 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:42.036290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.119325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37282b68-c809-4eca-9b45-93d309f97933 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.153323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838dfd1-e2e9-435c-ba7f-9b9364cf2f9f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.169280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.169941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.170861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.170861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.173120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:42.174617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:42.176627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 187/365] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:41 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:42.177436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.202706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.203459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.203745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.204021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.213366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:42.216686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:42.221545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:42.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:42.223301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 179/366] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:42.223980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.233171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:42.307386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e68d1-c851-4925-a532-709f3a315c37 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.355825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.356520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfa207-108d-4242-bb83-94da409f9ee3 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.357351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.357638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.357913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.359054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:42.360512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:42.367203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 188/367] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:42.367203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.407159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.407793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.408073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.408380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.422127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:42.427017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:42.427943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:42.428824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 180/368] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:42.429992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.491297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:42.497848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03649941-907f-4b88-b238-7e697e9193f4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.516682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:42.555249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.555869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.556156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.556469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.557208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:42.557529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:42.559022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:42.565236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e585eb7-58ac-459e-9f8d-a5d41f926a9b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.565967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 189/369] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:42.566979 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.617798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.618402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.618691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.618974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.619664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:42.619975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:42.621413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:42.633515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 181/370] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:42.639713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.729341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d0369-ca74-4cf4-9788-7e169e345917 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.777066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa9ed3-c739-4b28-a283-f097aab8b02a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:42.784627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.785247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.785797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.785797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.787910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=427bfb56dd934118aea1eaf475d0900a) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:42.787910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:42.788859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:42.795077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 190/371] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:42.795891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.836568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:42.849525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:42.850707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:42.850987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:42.851261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:42.855301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:42.855301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:42.855301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:42.858567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:42.884536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 182/372] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:42.890157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:42.984791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770e436-d471-467c-95af-4339fbb13e1f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.026248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.027281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.027871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.028461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.038626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d85f20-f135-425b-b4e1-8aea85e9a9b8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.081911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.082467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.082867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.083150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.110848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.112972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.147644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:43.148645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:43.162046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.163664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.236876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 191/373] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:43.245416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:43.272583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 183/374] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:43.276079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:43.375898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfc7ed-6932-4817-81aa-bb9091687353 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.398502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:43.411055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe89a3-cbe4-421f-b5a8-29c096872765 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.424556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:43.446465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.447216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.447511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.447788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] PATH_INFO: `/v3/projects/db1aad17b68042eda5d90f159ce8fc85` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.449076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] RBAC: Authorizing `identity:get_project(project_id=db1aad17b68042eda5d90f159ce8fc85)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.450606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.455936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 184/375] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:43 2022] GET /identity/v3/projects/db1aad17b68042eda5d90f159ce8fc85 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:43.458441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:43.464932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.465603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.465928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.466420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.467712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.469464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.475753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 192/376] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:43 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:43.476673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:43.617689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e195a-3e0d-47fb-bbd0-7e1e798cfd3e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.641490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fd876a-1407-4cb6-a405-a3e21806571e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.683971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.684634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.684916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.685194 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] PATH_INFO: `/v3/groups/b52c674f9ee242ceb5d2796f20e64dbe` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.696603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] RBAC: Authorizing `identity:get_group(group_id=b52c674f9ee242ceb5d2796f20e64dbe)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.698085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.700688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 185/377] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:43 2022] GET /identity/v3/groups/b52c674f9ee242ceb5d2796f20e64dbe => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:43.705574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.706492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.706745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:43.707313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.707789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.709668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.711680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.713851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 193/378] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:43 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:43.721132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:43.748629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:43.810000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:43.825390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5c8ae-c51a-4a18-bccd-c316c86ad3a2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.851409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f646a53-2d2f-4e3d-b8e4-e948f5088936 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:43.886572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322f817-bbe3-4537-b1a0-b4ced5ed7117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.887189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f817-bbe3-4537-b1a0-b4ced5ed7117 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.887541 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f817-bbe3-4537-b1a0-b4ced5ed7117 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.887892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322f817-bbe3-4537-b1a0-b4ced5ed7117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.888718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322f817-bbe3-4537-b1a0-b4ced5ed7117 None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:43.889097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322f817-bbe3-4537-b1a0-b4ced5ed7117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.890594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9322f817-bbe3-4537-b1a0-b4ced5ed7117 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.895916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb0cec-5e56-4d32-89e0-deb249d02ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:43.897187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb0cec-5e56-4d32-89e0-deb249d02ce0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:43.897481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb0cec-5e56-4d32-89e0-deb249d02ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:43.897605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 194/379] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:43 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:43.897770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb0cec-5e56-4d32-89e0-deb249d02ce0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:43.898534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb0cec-5e56-4d32-89e0-deb249d02ce0 None admin] RBAC: Adding query filter params (group.id=b52c674f9ee242ceb5d2796f20e64dbe, role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=db1aad17b68042eda5d90f159ce8fc85) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:43.898924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb0cec-5e56-4d32-89e0-deb249d02ce0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:43.908268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb0cec-5e56-4d32-89e0-deb249d02ce0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:43.916406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 186/380] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:43 2022] GET /identity/v3/role_assignments?group.id=b52c674f9ee242ceb5d2796f20e64dbe&scope.project.id=db1aad17b68042eda5d90f159ce8fc85&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:44.364490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5eb8-9699-4afc-8fa2-6d9752e785da None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:44.364808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5eb8-9699-4afc-8fa2-6d9752e785da None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:44.365061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5eb8-9699-4afc-8fa2-6d9752e785da None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:44.366711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 195/381] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:44.377472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b32ad-15fe-4dd3-b10f-1a3a67f21cd2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:44.377755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b32ad-15fe-4dd3-b10f-1a3a67f21cd2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:44.378032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b32ad-15fe-4dd3-b10f-1a3a67f21cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:44.405358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4e8b32ad-15fe-4dd3-b10f-1a3a67f21cd2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:44.406629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4e8b32ad-15fe-4dd3-b10f-1a3a67f21cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:44.494331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 187/382] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:44.824879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5eb8-9699-4afc-8fa2-6d9752e785da None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:44.924393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0142-edfd-44a4-b6e2-77255402abea None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:44.924928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0142-edfd-44a4-b6e2-77255402abea None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:44.924928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0142-edfd-44a4-b6e2-77255402abea None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:44.926531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 188/383] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:44.932346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b364-8428-45a3-9353-70133376fc3b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:44.932638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b364-8428-45a3-9353-70133376fc3b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:44.932917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119b364-8428-45a3-9353-70133376fc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:44.961975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d119b364-8428-45a3-9353-70133376fc3b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:44.963174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d119b364-8428-45a3-9353-70133376fc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:44.973685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:44.992485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5eb8-9699-4afc-8fa2-6d9752e785da None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:45.048566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:45.066305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 189/384] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:45.074766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:45.075473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.075703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.075984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.097921 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:45.102709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:45.103591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:45.104452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 196/385] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:45.109856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b364-8428-45a3-9353-70133376fc3b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:45.251065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119b364-8428-45a3-9353-70133376fc3b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:45.303711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:45.304355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.304640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.304916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.305598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:45.305903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:45.307281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:45.316026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 190/386] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:45.325567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:45.346227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:45.356806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:45.487669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1e97e-b94a-47d7-afe2-c510404e6fb8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:45.526359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e52df8-d7c0-417e-9ee4-645054c5e0d0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:45.526562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5124ea-572d-4e23-be93-676892dd090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:45.527023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5124ea-572d-4e23-be93-676892dd090e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.527505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5124ea-572d-4e23-be93-676892dd090e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.527940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5124ea-572d-4e23-be93-676892dd090e None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.529411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5124ea-572d-4e23-be93-676892dd090e None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:45.530853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5124ea-572d-4e23-be93-676892dd090e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:45.532912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 197/387] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:45 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:45.539394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812409-bcb8-40bf-a583-6aa12e6b7770 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.539859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812409-bcb8-40bf-a583-6aa12e6b7770 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.540312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b812409-bcb8-40bf-a583-6aa12e6b7770 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.542211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 198/388] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:45.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b812409-bcb8-40bf-a583-6aa12e6b7770 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:45.572082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bb69e-c713-42aa-88b7-117804ffb967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:45.573156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bb69e-c713-42aa-88b7-117804ffb967 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.573459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bb69e-c713-42aa-88b7-117804ffb967 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.573725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bb69e-c713-42aa-88b7-117804ffb967 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.588528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bb69e-c713-42aa-88b7-117804ffb967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-ac8bb69e-c713-42aa-88b7-117804ffb967 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:45.595474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:45.596427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:45.597284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 191/389] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:45.598429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7484d-b17d-4ba8-9ce6-a70b7f7def99 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.598527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7484d-b17d-4ba8-9ce6-a70b7f7def99 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.598751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd7484d-b17d-4ba8-9ce6-a70b7f7def99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.611100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:45.622990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-acd7484d-b17d-4ba8-9ce6-a70b7f7def99 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:45.624370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-acd7484d-b17d-4ba8-9ce6-a70b7f7def99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:45.669408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b812409-bcb8-40bf-a583-6aa12e6b7770 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:45.699785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:45.715434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 192/390] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:45.715434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7484d-b17d-4ba8-9ce6-a70b7f7def99 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:45.715979 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:45.716907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.717394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.717941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.719337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:45.728688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:45.730830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 199/391] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:45 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:45.737359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:45.831909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd7484d-b17d-4ba8-9ce6-a70b7f7def99 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:45.903370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:45.903994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.904302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.904585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.905273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:45.905583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:45.906986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:45.931351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 193/392] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:45.935844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:45.940952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748079a-cefb-4d49-9006-a4fb2b28ea2c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:45.974155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:45.989254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42581ddc-a7b7-407f-a54f-604eaf7cd36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:45.989923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42581ddc-a7b7-407f-a54f-604eaf7cd36c None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:45.990727 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42581ddc-a7b7-407f-a54f-604eaf7cd36c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:45.999475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42581ddc-a7b7-407f-a54f-604eaf7cd36c None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:45.999475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42581ddc-a7b7-407f-a54f-604eaf7cd36c None admin] RBAC: Authorizing `identity:create_grant(project_id=427bfb56dd934118aea1eaf475d0900a, group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:45.999475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42581ddc-a7b7-407f-a54f-604eaf7cd36c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:46.038446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:46.079599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de0ee3-1c14-40ab-835d-f547830d4be1 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:46.092564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 200/393] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Aug 22 05:31:45 2022] PUT /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/bde35a779ee4459c84bc6cc697de4145 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:46.094588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1859-40fb-479c-8178-6ed04e9e2dcc None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.095108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1859-40fb-479c-8178-6ed04e9e2dcc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.095600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe1859-40fb-479c-8178-6ed04e9e2dcc None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.097588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 201/394] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:46.098732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1859-40fb-479c-8178-6ed04e9e2dcc None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.124294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b6eae-aaad-4c65-994a-c3b47e6b391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:46.125019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6eae-aaad-4c65-994a-c3b47e6b391e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.125306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6eae-aaad-4c65-994a-c3b47e6b391e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.125648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b6eae-aaad-4c65-994a-c3b47e6b391e None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.126937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6eae-aaad-4c65-994a-c3b47e6b391e None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:46.128596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b6eae-aaad-4c65-994a-c3b47e6b391e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:46.130607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 194/395] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:45 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:46.132405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195869b-8387-48f1-95cc-b82ec84de71a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.132523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195869b-8387-48f1-95cc-b82ec84de71a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.132735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195869b-8387-48f1-95cc-b82ec84de71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.153492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-0195869b-8387-48f1-95cc-b82ec84de71a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:46.154414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0195869b-8387-48f1-95cc-b82ec84de71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:46.227057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe1859-40fb-479c-8178-6ed04e9e2dcc None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:46.235675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 195/396] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:46.236399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195869b-8387-48f1-95cc-b82ec84de71a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.265641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:46.266662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.267160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.267685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.280134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:46.287600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:46.288536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:46.289358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:46.292066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 202/397] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:46.297012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:46.299906 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.354339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195869b-8387-48f1-95cc-b82ec84de71a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:46.360305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:46.395721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346bf29-4d4a-4c25-bbf1-d9f9c10ddf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:46.396835 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bf29-4d4a-4c25-bbf1-d9f9c10ddf87 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.397350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bf29-4d4a-4c25-bbf1-d9f9c10ddf87 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.397844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346bf29-4d4a-4c25-bbf1-d9f9c10ddf87 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.407892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346bf29-4d4a-4c25-bbf1-d9f9c10ddf87 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:46.407892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346bf29-4d4a-4c25-bbf1-d9f9c10ddf87 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:46.408898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 196/398] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:46 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:46.409931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46cd2b-030d-4796-b228-6031f64e17d6 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.410218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46cd2b-030d-4796-b228-6031f64e17d6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.410498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46cd2b-030d-4796-b228-6031f64e17d6 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.412536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 197/399] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:46.416058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46cd2b-030d-4796-b228-6031f64e17d6 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.466140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed6feb-4325-4fd2-b2d4-7b6293e7fa06 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:46.502802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fdd09-8a55-4d8c-b205-085fd13a124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:46.503823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fdd09-8a55-4d8c-b205-085fd13a124e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.504418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fdd09-8a55-4d8c-b205-085fd13a124e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.504887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fdd09-8a55-4d8c-b205-085fd13a124e None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.505788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fdd09-8a55-4d8c-b205-085fd13a124e None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:46.506310 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fdd09-8a55-4d8c-b205-085fd13a124e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:46.508171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fdd09-8a55-4d8c-b205-085fd13a124e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:46.517612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 203/400] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:46.519239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f436732-1176-4c29-9ae0-b272525a190c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.519723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f436732-1176-4c29-9ae0-b272525a190c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.520281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f436732-1176-4c29-9ae0-b272525a190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.532663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46cd2b-030d-4796-b228-6031f64e17d6 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:46.540955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-7f436732-1176-4c29-9ae0-b272525a190c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:46.542419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7f436732-1176-4c29-9ae0-b272525a190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:46.557261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:46.567669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:46.568435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.568719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.568997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.570896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a1603a8a0d44aacb128e690e2aebfe7, group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:46.572366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:46.613490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 204/401] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:46.614464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f436732-1176-4c29-9ae0-b272525a190c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.648923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 198/402] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Aug 22 05:31:46 2022] PUT /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:46.650095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.660445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:46.783358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1e13b-6eba-4cbf-b121-3a2cb0a21016 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:46.796748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f436732-1176-4c29-9ae0-b272525a190c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:46.827980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:46.829002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.829488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.829994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.844027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:46.850394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:46.851334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:46.852127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:46.854828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 199/403] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:46.862908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.881841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:46.882494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:46.882770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:46.883041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:46.884271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:46.885715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:46.887309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 205/404] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:46 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:46.893777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:46.932500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:46.993084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb99d3-dada-4115-80f5-9ec5bdf41218 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.014256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269e53c-6ff2-40d6-920b-2b1b71aa8bd2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.016886 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:47.033273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.034062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.034407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.034751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.035541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:47.035903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.037590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.047412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 200/405] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:47.052985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.058563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.059419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.059872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.060397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.061707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.063780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.066330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 206/406] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:46 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:47.067706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.181359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8eb14-c9df-412d-8ab6-62b45b88cfbe None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.184992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1202-a019-4c67-bdbf-0c8ca4f51b12 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.190355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:47.220618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.221459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.221781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.222100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.222387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.222595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.222689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] PATH_INFO: `/v3/groups/b52c674f9ee242ceb5d2796f20e64dbe` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.223130 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.223860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] RBAC: Authorizing `identity:get_group(group_id=b52c674f9ee242ceb5d2796f20e64dbe)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.225577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.231298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 207/407] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:47 2022] GET /identity/v3/groups/b52c674f9ee242ceb5d2796f20e64dbe => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:47.231298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.236870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:47.242516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:47.243491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:47.244345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:47.247765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 201/408] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:47.248869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.272013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:47.335607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e577f-125a-4d02-bff6-725ea6f18109 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.358637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acc6c0-9c70-4309-94df-f205d007567e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.371911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.372735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.373086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.373465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.376001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] RBAC: Authorizing `identity:create_grant(project_id=427bfb56dd934118aea1eaf475d0900a, group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.378046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.395563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.401335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.401335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.401335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] PATH_INFO: `/v3/projects/db1aad17b68042eda5d90f159ce8fc85` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.401335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=db1aad17b68042eda5d90f159ce8fc85)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.401335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.401335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 202/409] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:47 2022] GET /identity/v3/projects/db1aad17b68042eda5d90f159ce8fc85 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:47.401876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.436152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:47.471504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 208/410] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Aug 22 05:31:47 2022] PUT /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:47.473072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.522531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a033a-0db8-4125-9815-66385bf7b6c4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.604746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.605610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.606040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.606461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.607327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:47.607783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.614070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.630612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 203/411] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:47.637966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.662530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:47.670340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83041cf4-7a99-449b-b164-4ce898586537 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.719671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.720695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.721122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.721778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] PATH_INFO: `/v3/projects/db1aad17b68042eda5d90f159ce8fc85/groups/b52c674f9ee242ceb5d2796f20e64dbe/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.726106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] RBAC: Authorizing `identity:create_grant(project_id=db1aad17b68042eda5d90f159ce8fc85, group_id=b52c674f9ee242ceb5d2796f20e64dbe, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.727708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.753058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:47.762377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9c62f-201f-4dc1-91fe-753df0509a5d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:47.798637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:47.799541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:47.800053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:47.800565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:47.801894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:47.804062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:47.810642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 204/412] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:47 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:47.812059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:47.830806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 209/413] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Aug 22 05:31:47 2022] PUT /identity/v3/projects/db1aad17b68042eda5d90f159ce8fc85/groups/b52c674f9ee242ceb5d2796f20e64dbe/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:47.966180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4efe7-6651-468c-a938-17ba41bf6b11 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:48.011451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfdf3a-4a72-45e4-a20d-3a077a709d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:48.012007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfdf3a-4a72-45e4-a20d-3a077a709d68 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:48.012323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfdf3a-4a72-45e4-a20d-3a077a709d68 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:48.012607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfdf3a-4a72-45e4-a20d-3a077a709d68 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:48.013767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfdf3a-4a72-45e4-a20d-3a077a709d68 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:48.015215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfdf3a-4a72-45e4-a20d-3a077a709d68 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:48.017187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 205/414] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:47 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:48.023563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:48.138742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be96d8-5a06-445e-9e77-608f4e59fd5e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:48.178567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:48.179233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:48.179516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:48.179797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:48.182125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a1603a8a0d44aacb128e690e2aebfe7, group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:48.183606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:48.222588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b810fb-aa4c-4092-b09b-81f2b6cd9c7d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:48.222919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b810fb-aa4c-4092-b09b-81f2b6cd9c7d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:48.223171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b810fb-aa4c-4092-b09b-81f2b6cd9c7d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:48.225462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 206/415] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:48.230533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7beb38-fc54-4a16-a945-1ec98dbbf643 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:48.230828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7beb38-fc54-4a16-a945-1ec98dbbf643 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:48.231114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7beb38-fc54-4a16-a945-1ec98dbbf643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:48.249937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ad7beb38-fc54-4a16-a945-1ec98dbbf643 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:48.251148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ad7beb38-fc54-4a16-a945-1ec98dbbf643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:48.280029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:48.304057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 210/416] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Aug 22 05:31:48 2022] PUT /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3/roles/bde35a779ee4459c84bc6cc697de4145 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:31:48.335459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 207/417] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:48.614189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:48.638726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:48.741789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bc3e47-8194-4ce4-a504-0ab705bf9313 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:48.776240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:48.776882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:48.777166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:48.777451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:48.789607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:48.794337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:48.795276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:48.796225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 211/418] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:48.803431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7beb38-fc54-4a16-a945-1ec98dbbf643 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:48.949425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7beb38-fc54-4a16-a945-1ec98dbbf643 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:48.985210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7315c72d-62d8-48cb-b2d4-9e82e4a67c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:48.985854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315c72d-62d8-48cb-b2d4-9e82e4a67c45 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:48.986083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315c72d-62d8-48cb-b2d4-9e82e4a67c45 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:48.986359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7315c72d-62d8-48cb-b2d4-9e82e4a67c45 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:48.987031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315c72d-62d8-48cb-b2d4-9e82e4a67c45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:48.987339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315c72d-62d8-48cb-b2d4-9e82e4a67c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:48.988753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7315c72d-62d8-48cb-b2d4-9e82e4a67c45 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:48.998212 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 208/419] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:49.003784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:49.054014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3b45e-cc07-4849-a763-29c5b27bca49 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.054343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3b45e-cc07-4849-a763-29c5b27bca49 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.054575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3b45e-cc07-4849-a763-29c5b27bca49 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.056124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 209/420] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:49.070440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ec2a-846d-4de3-8cf2-083223f58741 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.070732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ec2a-846d-4de3-8cf2-083223f58741 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.071011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ec2a-846d-4de3-8cf2-083223f58741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.109190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2708ec2a-846d-4de3-8cf2-083223f58741 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:49.110450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2708ec2a-846d-4de3-8cf2-083223f58741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:49.120571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:49.127065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b92d3e-4829-463d-8015-95b3801dcce5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:49.144689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:49.161858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:49.162471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.162756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.163036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.232040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 210/421] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:49.235013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:49.236497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:49.316583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:49.339658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 212/422] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:49.345065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708ec2a-846d-4de3-8cf2-083223f58741 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:49.459331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708ec2a-846d-4de3-8cf2-083223f58741 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:49.495236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:49.495786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.496068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.496377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.497512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:49.498971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:49.500942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 211/423] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:49 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:49.506674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:49.525921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:49.556545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:49.645602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552bb15-b04a-48f4-b5c8-b0f217f38232 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:49.668339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c087811-be6d-4a35-8fcd-e287d492c148 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:49.680526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:49.681169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.681454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.681735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.683022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:49.684662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:49.686335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 213/424] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:49 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:49.692225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:49.736924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:49.737568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.737852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.738190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.740677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:49.756278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:49.765971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:49.766883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:49.767681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 212/425] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:49.774520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:49.796421 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363344ba-5bc5-46cb-8c2a-a9af982e8a92 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:49.833012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:49.833673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.833958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.834238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.835236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=427bfb56dd934118aea1eaf475d0900a) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:49.835563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:49.837359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:49.848319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 214/426] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:49 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:49.908238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:49.928353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e386a84-56e4-4dda-98c7-4b2c8b460151 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:49.965477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482093b-529a-4724-8db2-663d59a47e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:49.966484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482093b-529a-4724-8db2-663d59a47e1f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:49.966769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482093b-529a-4724-8db2-663d59a47e1f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:49.967048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482093b-529a-4724-8db2-663d59a47e1f None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:49.967733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482093b-529a-4724-8db2-663d59a47e1f None admin] RBAC: Adding query filter params (name=member) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:49.968102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482093b-529a-4724-8db2-663d59a47e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:49.969602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3482093b-529a-4724-8db2-663d59a47e1f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:49.979776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 213/427] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:49.985213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.104293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dda069-b03b-4987-8ea0-c731ad4590a2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:50.112639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f4484-6a87-4517-8076-d70060078437 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.113132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f4484-6a87-4517-8076-d70060078437 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.113317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f4484-6a87-4517-8076-d70060078437 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.114870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 214/428] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:50.115359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:50.130021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc8b98-3c01-4707-8f80-db8cf3618dcf None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.130364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc8b98-3c01-4707-8f80-db8cf3618dcf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.131154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc8b98-3c01-4707-8f80-db8cf3618dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.142729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d3188c-b33d-404e-bf95-be1bccc3844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:50.143346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3188c-b33d-404e-bf95-be1bccc3844a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.143623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3188c-b33d-404e-bf95-be1bccc3844a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.143899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d3188c-b33d-404e-bf95-be1bccc3844a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.155980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-91cc8b98-3c01-4707-8f80-db8cf3618dcf None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:50.157612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-91cc8b98-3c01-4707-8f80-db8cf3618dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:50.244291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3188c-b33d-404e-bf95-be1bccc3844a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:50.246713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d3188c-b33d-404e-bf95-be1bccc3844a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:50.250222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 215/429] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:50.351645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 215/430] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:50.357442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc8b98-3c01-4707-8f80-db8cf3618dcf None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.418735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357532d9-a477-4355-8b54-53eafbf9d346 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.419185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357532d9-a477-4355-8b54-53eafbf9d346 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.419568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357532d9-a477-4355-8b54-53eafbf9d346 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.421277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 216/431] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:31:50.426240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee5a9-c2fd-48e1-9dc6-b0a21546a7ee None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.426641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee5a9-c2fd-48e1-9dc6-b0a21546a7ee None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.427012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee5a9-c2fd-48e1-9dc6-b0a21546a7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.442004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:50.448865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ac8ee5a9-c2fd-48e1-9dc6-b0a21546a7ee None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:50.450753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ac8ee5a9-c2fd-48e1-9dc6-b0a21546a7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:50.454477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:50.469997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc8b98-3c01-4707-8f80-db8cf3618dcf None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:50.506978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:50.507927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.508468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.508953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.510264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:50.512918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:50.515775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 216/432] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:50 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:50.522875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.532880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 217/433] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:50.534034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee5a9-c2fd-48e1-9dc6-b0a21546a7ee None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.640125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdadb-e0ed-4f14-b469-821dfda5228b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:50.648511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee5a9-c2fd-48e1-9dc6-b0a21546a7ee None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:50.685781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:50.686418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.686703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.686981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.687237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:50.688045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.688352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.688656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.690479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:50.692059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:50.694499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 217/434] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:50 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:50.697157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:50.700511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.701054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:50.706087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:50.707939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:50.708978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 218/435] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:50.713166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:50.713646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.809410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e0cc5-533a-4f9d-af3c-2803ec8dcf71 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:50.824110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b393b-1a9d-45de-951c-50a302e12feb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:50.844255 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc7540-33d4-4a01-94cd-44e24c4b7c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:50.845062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7540-33d4-4a01-94cd-44e24c4b7c58 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.845343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7540-33d4-4a01-94cd-44e24c4b7c58 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.845625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc7540-33d4-4a01-94cd-44e24c4b7c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.846348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7540-33d4-4a01-94cd-44e24c4b7c58 None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:50.846661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7540-33d4-4a01-94cd-44e24c4b7c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:50.848099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc7540-33d4-4a01-94cd-44e24c4b7c58 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:50.853870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 218/436] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:50 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:50.854982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ead2-1d9f-49a0-9a13-7bd90638e844 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.855267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ead2-1d9f-49a0-9a13-7bd90638e844 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.855548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ead2-1d9f-49a0-9a13-7bd90638e844 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.857002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 219/437] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:50.857562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ead2-1d9f-49a0-9a13-7bd90638e844 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.863786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f29dd-59bc-4220-8b30-80767906e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:50.864447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f29dd-59bc-4220-8b30-80767906e48c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.864725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f29dd-59bc-4220-8b30-80767906e48c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.865049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f29dd-59bc-4220-8b30-80767906e48c None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.866218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f29dd-59bc-4220-8b30-80767906e48c None admin] RBAC: Adding query filter params (name=member) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:50.866218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f29dd-59bc-4220-8b30-80767906e48c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:50.867456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f29dd-59bc-4220-8b30-80767906e48c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:50.880015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 219/438] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:31:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:50.880015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d6b6-e925-4a7d-8cf1-ad365b7174d4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:50.880015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d6b6-e925-4a7d-8cf1-ad365b7174d4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:50.880015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d6b6-e925-4a7d-8cf1-ad365b7174d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:50.899772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3909d6b6-e925-4a7d-8cf1-ad365b7174d4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:50.900936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3909d6b6-e925-4a7d-8cf1-ad365b7174d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:50.953926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:50.966304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:50.979092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 220/439] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:50.980303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d6b6-e925-4a7d-8cf1-ad365b7174d4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:50.990927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ead2-1d9f-49a0-9a13-7bd90638e844 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.038226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.038862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.039149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.039699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.053560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:51.058814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:51.059709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:51.060535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 220/440] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:51.065566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.104038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d6b6-e925-4a7d-8cf1-ad365b7174d4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.140637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.141471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.141924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.142347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.176804 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0770b-76bd-424f-9213-5eb948916cea None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.204638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.212136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986134e-2659-4172-98d4-5da585221414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.216317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986134e-2659-4172-98d4-5da585221414 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.216317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986134e-2659-4172-98d4-5da585221414 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.216317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986134e-2659-4172-98d4-5da585221414 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.216317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986134e-2659-4172-98d4-5da585221414 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:51.216317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986134e-2659-4172-98d4-5da585221414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.216317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986134e-2659-4172-98d4-5da585221414 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.216742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.217141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.218303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.225637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 221/441] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:51.230933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986134e-2659-4172-98d4-5da585221414 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.322174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 221/442] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:51.323017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.334511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986134e-2659-4172-98d4-5da585221414 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.371660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.372279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.372566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.372840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.410227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.418863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5e41d-72b7-4145-9ea8-e50344b70d85 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.432538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.439023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.440539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.452009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.452665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.452948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.453224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.464230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:51.468995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:51.469920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 222/443] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:51.473182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.538797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 222/444] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 22 05:31:51.539634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.568655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72920-8c72-4f42-b6d0-db8d58a6761e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.601710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.602332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.602617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.602898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] PATH_INFO: `/v3/projects/427bfb56dd934118aea1eaf475d0900a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.604042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] RBAC: Authorizing `identity:get_project(project_id=427bfb56dd934118aea1eaf475d0900a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.605526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.607136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 223/445] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/projects/427bfb56dd934118aea1eaf475d0900a => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:51.607997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.629287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.632680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.638339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5508b-fdde-4ce8-b101-bd3a52aaa7f6 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.673901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.674501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.674784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.675065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.675739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:51.676047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.678070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.686538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 223/446] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:51.687316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.706212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec480e82-67e4-4479-bcc2-890357ec4f1a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.740113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.740756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.741034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.741306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] PATH_INFO: `/v3/projects/db1aad17b68042eda5d90f159ce8fc85` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.742409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] RBAC: Authorizing `identity:get_project(project_id=db1aad17b68042eda5d90f159ce8fc85)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.743816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.750031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 224/447] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/projects/db1aad17b68042eda5d90f159ce8fc85 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:51.750031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.784607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44019377-9580-4439-addc-19a3c9fd994e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.816756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.817374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.817659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.817969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.819084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.820558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.822117 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 224/448] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:51.822868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:51.838177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.850255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514d674-2a31-4cc1-881d-e81bcfb83fba None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.853636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:51.883049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.883649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.883930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.884224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.922470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524b518-ea6a-43bb-a4f3-13ae98865476 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:51.949132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.950523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.954550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:51.955166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:51.955447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:51.955723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] PATH_INFO: `/v3/groups/b52c674f9ee242ceb5d2796f20e64dbe` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:51.956845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] RBAC: Authorizing `identity:get_group(group_id=b52c674f9ee242ceb5d2796f20e64dbe)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:51.958260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:51.960641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 225/449] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/groups/b52c674f9ee242ceb5d2796f20e64dbe => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:51.961378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:52.033813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:52.046058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 225/450] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:31:52.046920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:52.056335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:52.064064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4098d-42fb-44ee-96c9-20d3bd7eaa37 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:52.097915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:52.098522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:52.099053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:52.099353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:52.100250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=6ba30e1147874694ad926bff7dd0bfc9, scope.project.id=427bfb56dd934118aea1eaf475d0900a) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:52.100954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:52.102393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:52.109275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 226/451] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:51 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=427bfb56dd934118aea1eaf475d0900a&role.id=6ba30e1147874694ad926bff7dd0bfc9 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:52.110558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:52.160814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d502e-9002-4ade-9cda-6938c2ecc0d0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:52.204130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:52.204696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:52.205304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:52.205304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:52.205969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] RBAC: Adding query filter params (group.id=b52c674f9ee242ceb5d2796f20e64dbe, role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=db1aad17b68042eda5d90f159ce8fc85) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:52.206280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:52.207733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:52.224231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 226/452] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:52 2022] GET /identity/v3/role_assignments?group.id=b52c674f9ee242ceb5d2796f20e64dbe&scope.project.id=db1aad17b68042eda5d90f159ce8fc85&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:52.233339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80a3a5-2483-4e6b-a0af-b93fe1476e57 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:52.283182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:52.284370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:52.284370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:52.284568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] PATH_INFO: `/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:52.290333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] RBAC: Authorizing `identity:get_project(project_id=0a1603a8a0d44aacb128e690e2aebfe7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:52.290333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:52.290333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 227/453] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:31:52 2022] GET /identity/v3/projects/0a1603a8a0d44aacb128e690e2aebfe7 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:52.295195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:52.354632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:52.407825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a8c50-ed74-40a7-928c-f9cecfcd1807 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:52.444785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2042091-3e28-4902-b02c-7d187fe77506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:52.445421 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2042091-3e28-4902-b02c-7d187fe77506 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:52.445702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2042091-3e28-4902-b02c-7d187fe77506 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:52.445975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2042091-3e28-4902-b02c-7d187fe77506 None admin] PATH_INFO: `/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:52.447080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2042091-3e28-4902-b02c-7d187fe77506 None admin] RBAC: Authorizing `identity:get_group(group_id=7b1ac4ff3a0347ef86b2fb94bce0d3e3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:52.448551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2042091-3e28-4902-b02c-7d187fe77506 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:52.450272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 227/454] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Aug 22 05:31:52 2022] GET /identity/v3/groups/7b1ac4ff3a0347ef86b2fb94bce0d3e3 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:52.455994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:52.483747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:52.556451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54defdf-7ffa-4439-b123-4bce7ceca453 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:52.592986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeede60-d2b4-4cb6-9987-07ee79bcbb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:52.593594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeede60-d2b4-4cb6-9987-07ee79bcbb31 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:52.593883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeede60-d2b4-4cb6-9987-07ee79bcbb31 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:52.594166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeede60-d2b4-4cb6-9987-07ee79bcbb31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:52.594900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeede60-d2b4-4cb6-9987-07ee79bcbb31 None admin] RBAC: Adding query filter params (group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3, role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:52.595220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeede60-d2b4-4cb6-9987-07ee79bcbb31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:52.596765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeede60-d2b4-4cb6-9987-07ee79bcbb31 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:52.602794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 228/455] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Aug 22 05:31:52 2022] GET /identity/v3/role_assignments?group.id=7b1ac4ff3a0347ef86b2fb94bce0d3e3&scope.project.id=0a1603a8a0d44aacb128e690e2aebfe7&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:55.070242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179299-95a6-4c4e-b028-b04f1c43a535 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.070760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179299-95a6-4c4e-b028-b04f1c43a535 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.070836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af179299-95a6-4c4e-b028-b04f1c43a535 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.072376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 228/456] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:55.077711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7e412-c555-47cc-af3d-2d0bb958ca87 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.078565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7e412-c555-47cc-af3d-2d0bb958ca87 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.079046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7e412-c555-47cc-af3d-2d0bb958ca87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.098554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-0dc7e412-c555-47cc-af3d-2d0bb958ca87 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:55.100110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0dc7e412-c555-47cc-af3d-2d0bb958ca87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:55.189358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 229/457] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:55.350187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b54e8-c44a-4b32-90dc-846c345e1d89 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.350472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b54e8-c44a-4b32-90dc-846c345e1d89 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.350673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b54e8-c44a-4b32-90dc-846c345e1d89 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.352149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 229/458] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:55.370498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee3e66-1eff-4d36-9083-4751eccd1180 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.370793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee3e66-1eff-4d36-9083-4751eccd1180 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.371083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee3e66-1eff-4d36-9083-4751eccd1180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.390622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-0bee3e66-1eff-4d36-9083-4751eccd1180 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:55.391816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0bee3e66-1eff-4d36-9083-4751eccd1180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:55.409714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:55.461165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ec31-bdb7-4441-8b79-9fc881500af0 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.461449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ec31-bdb7-4441-8b79-9fc881500af0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.461983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35ec31-bdb7-4441-8b79-9fc881500af0 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.463773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 230/459] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:55.469909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46bb3-cdc7-4d5e-ab78-dc1c8830f5ad None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.470450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46bb3-cdc7-4d5e-ab78-dc1c8830f5ad None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.470929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b46bb3-cdc7-4d5e-ab78-dc1c8830f5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.478420 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 230/460] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:55.501178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d0b46bb3-cdc7-4d5e-ab78-dc1c8830f5ad None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:55.502718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d0b46bb3-cdc7-4d5e-ab78-dc1c8830f5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:55.554688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee3e66-1eff-4d36-9083-4751eccd1180 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:55.614400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 231/461] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:55.683595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee3e66-1eff-4d36-9083-4751eccd1180 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:55.736881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:55.737524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.737813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.738094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.751687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:55.753179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:31:55.773911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:55.774832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:31:55.775686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:31:55.775686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:55.775686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:55.777260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 231/462] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:55.782166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b46bb3-cdc7-4d5e-ab78-dc1c8830f5ad None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:55.837037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:55.852311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:55.856287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:55.914278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b46bb3-cdc7-4d5e-ab78-dc1c8830f5ad None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:55.959513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7675442-a43d-4f38-a268-0fa781336b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:55.960464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7675442-a43d-4f38-a268-0fa781336b2c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.960747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7675442-a43d-4f38-a268-0fa781336b2c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.961022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7675442-a43d-4f38-a268-0fa781336b2c None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.961677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7675442-a43d-4f38-a268-0fa781336b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:55.961983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7675442-a43d-4f38-a268-0fa781336b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:55.963470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7675442-a43d-4f38-a268-0fa781336b2c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:55.975718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 232/463] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:55.977139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d7dc-2f18-45e1-928d-7381ac82c241 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:55.977572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d7dc-2f18-45e1-928d-7381ac82c241 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:55.977993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d7dc-2f18-45e1-928d-7381ac82c241 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:55.979448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 233/464] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:55.984416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d7dc-2f18-45e1-928d-7381ac82c241 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:55.988257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819b9e3-179f-4316-8221-f652bb427efe None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:56.022191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:56.022820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.023297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.023585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.033807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:56.035279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:31:56.049293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:56.050285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:31:56.051125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:31:56.051125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:56.051125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:56.051125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 232/465] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:31:56.051125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:56.098374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d7dc-2f18-45e1-928d-7381ac82c241 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:56.107502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:56.110331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:56.134857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f369581-a9d4-444e-b2b3-f97e8e7760e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:56.135493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369581-a9d4-444e-b2b3-f97e8e7760e7 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.135775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369581-a9d4-444e-b2b3-f97e8e7760e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.136050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369581-a9d4-444e-b2b3-f97e8e7760e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.147559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f369581-a9d4-444e-b2b3-f97e8e7760e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:56.149033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f369581-a9d4-444e-b2b3-f97e8e7760e7 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:56.153842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a797fe6-03a6-4906-ba7c-1ea29f4a3f15 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-0f369581-a9d4-444e-b2b3-f97e8e7760e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:31:56.163136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:56.164045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:31:56.165355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:31:56.165355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:56.165355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:56.165355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 234/466] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:56.165591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15fea-0bfb-4cbe-af08-a6c85f5f1b93 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.166026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15fea-0bfb-4cbe-af08-a6c85f5f1b93 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.166026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15fea-0bfb-4cbe-af08-a6c85f5f1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.184412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-8eb15fea-0bfb-4cbe-af08-a6c85f5f1b93 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:56.185598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8eb15fea-0bfb-4cbe-af08-a6c85f5f1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:56.194122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:56.194733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.195024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.195331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.195953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:56.197444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:56.256390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 235/467] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:56.256998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15fea-0bfb-4cbe-af08-a6c85f5f1b93 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:56.301552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 233/468] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:56 2022] POST /identity/v3/users => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:56.303309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:56.357239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:56.367354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15fea-0bfb-4cbe-af08-a6c85f5f1b93 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:56.404167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:56.404824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.405107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.405444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.406112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:56.406424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:56.407833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:56.418693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e49096-592c-445b-affe-dbdadbee576f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:56.434897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 236/469] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:56.440221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:56.456658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:56.464047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:56.466086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.466385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.466727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.467428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:56.467739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:56.469205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:56.497791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 234/470] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:56.505457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:56.598140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308079cd-9418-4fd7-b8c7-21517e7bf140 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:56.640629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ac6c8-62f0-4fc0-8dcf-a72f04f2853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:56.641264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac6c8-62f0-4fc0-8dcf-a72f04f2853f None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.641551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac6c8-62f0-4fc0-8dcf-a72f04f2853f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.641831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ac6c8-62f0-4fc0-8dcf-a72f04f2853f None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.642487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ac6c8-62f0-4fc0-8dcf-a72f04f2853f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:56.643955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ac6c8-62f0-4fc0-8dcf-a72f04f2853f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:56.659976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d2bebf-3fec-4a90-8ac0-09c4fba0e9af None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:56.695552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d4108-e803-4d5e-a788-20224245fe64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:56.696087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d4108-e803-4d5e-a788-20224245fe64 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.696402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d4108-e803-4d5e-a788-20224245fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.696686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d4108-e803-4d5e-a788-20224245fe64 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.697334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d4108-e803-4d5e-a788-20224245fe64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:56.698989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d4108-e803-4d5e-a788-20224245fe64 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:56.750682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 237/471] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:56 2022] POST /identity/v3/users => generated 248 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:31:56.752028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd7f1-4eb1-46d8-aa50-b7ab4b602328 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.752436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd7f1-4eb1-46d8-aa50-b7ab4b602328 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.752793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fd7f1-4eb1-46d8-aa50-b7ab4b602328 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.754452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 238/472] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:56.754941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd7f1-4eb1-46d8-aa50-b7ab4b602328 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:56.778991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:56.793543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 235/473] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:56 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:56.799901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66d70-f964-49d7-bb3c-2f6973fcd070 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:56.799901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66d70-f964-49d7-bb3c-2f6973fcd070 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:56.799901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef66d70-f964-49d7-bb3c-2f6973fcd070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:56.821163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fef66d70-f964-49d7-bb3c-2f6973fcd070 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:56.822970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fef66d70-f964-49d7-bb3c-2f6973fcd070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:56.856930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:56.918169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 236/474] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:56.955546 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fd7f1-4eb1-46d8-aa50-b7ab4b602328 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:57.010235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:57.010885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:57.011174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:57.011457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:57.024939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:57.026488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:31:57.042068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:57.042999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:31:57.043868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:31:57.043868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:57.043868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:57.043868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 239/475] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:57.049064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66d70-f964-49d7-bb3c-2f6973fcd070 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:57.168118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef66d70-f964-49d7-bb3c-2f6973fcd070 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:57.210630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:57.211169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:57.211451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:57.211728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:57.212416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:57.212725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:57.214060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:57.214495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:57.227291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 237/476] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:57.241650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:57.261229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:57.350957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36cd92a-fee1-4516-8b62-653bfb9cee35 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:57.357278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:57.396434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:57.397124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:57.397412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:57.397692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:57.399152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:57.400768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:57.417901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997dccd2-3b76-4e25-8652-8a11984be842 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:57.453658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:57.454544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:57.454834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:57.455111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:57.455788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:57.457274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:57.507042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.sql.core [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 05:31:57.507042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 05:31:57.507042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [parameters: {'id': '89c422289e234f64aeb0f6ff8f021b3b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 05:31:57.507042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82146) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 05:31:57.514095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 238/477] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:31:57 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application conn.query(q) Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result.read() Aug 22 05:31:57.541180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return ref.to_dict() Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 05:31:57.542139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application next(self.gen) Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application yield resource Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application next(self.gen) Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise self.value Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application session.commit() Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 05:31:57.543069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.session.flush() Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application compat.raise_( Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 05:31:57.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 05:31:57.545792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application conn.query(q) Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result.read() Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 05:31:57.547841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [parameters: {'id': '89c422289e234f64aeb0f6ff8f021b3b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:57.549777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 22 05:31:57.551207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:57.556946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 240/478] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Aug 22 05:31:57 2022] POST /identity/v3/roles => generated 144 bytes in 329 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:57.558616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:57.676128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:57.718111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34aafa-390e-4735-9f1a-9d12f936a335 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:57.755813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffb02d-dbe0-4445-86c3-16adeac52232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:57.756494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb02d-dbe0-4445-86c3-16adeac52232 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:57.756782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb02d-dbe0-4445-86c3-16adeac52232 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:57.757118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffb02d-dbe0-4445-86c3-16adeac52232 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:57.767161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ffb02d-dbe0-4445-86c3-16adeac52232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-19ffb02d-dbe0-4445-86c3-16adeac52232 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:57.772400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:57.773263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:57.774073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 239/479] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:31:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:57.779987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:57.889648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e1798-18a6-46cb-80fa-c138e1b076a1 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:57.913439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:57.927624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904aaa-7eb7-4e52-9686-6e4e3a6c7ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:57.928257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904aaa-7eb7-4e52-9686-6e4e3a6c7ec2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:57.928541 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904aaa-7eb7-4e52-9686-6e4e3a6c7ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:57.928816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904aaa-7eb7-4e52-9686-6e4e3a6c7ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:57.929840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904aaa-7eb7-4e52-9686-6e4e3a6c7ec2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:57.929840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904aaa-7eb7-4e52-9686-6e4e3a6c7ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:57.931192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904aaa-7eb7-4e52-9686-6e4e3a6c7ec2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:57.940370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 241/480] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:31:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:31:58.601701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dee7a-07f1-4007-baa4-fab5c11b2bf6 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:58.602329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dee7a-07f1-4007-baa4-fab5c11b2bf6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:58.602329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421dee7a-07f1-4007-baa4-fab5c11b2bf6 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:58.603738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 240/481] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:58.626014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c45e-e1c0-4f76-83bd-fb48877ecc42 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:58.626660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c45e-e1c0-4f76-83bd-fb48877ecc42 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:58.626660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304c45e-e1c0-4f76-83bd-fb48877ecc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:58.649996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4304c45e-e1c0-4f76-83bd-fb48877ecc42 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:58.651267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4304c45e-e1c0-4f76-83bd-fb48877ecc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:58.738689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 242/482] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:59.149207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019680-6ffc-46f0-8a70-5267cce2e131 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.149611 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019680-6ffc-46f0-8a70-5267cce2e131 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.149782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019680-6ffc-46f0-8a70-5267cce2e131 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.151434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304c45e-e1c0-4f76-83bd-fb48877ecc42 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:59.154676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 241/483] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:59.160980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a720-8cd9-4746-b4b0-89c1f8468005 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.161348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a720-8cd9-4746-b4b0-89c1f8468005 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.161622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a720-8cd9-4746-b4b0-89c1f8468005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.197635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e098a720-8cd9-4746-b4b0-89c1f8468005 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:59.198824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e098a720-8cd9-4746-b4b0-89c1f8468005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:59.323032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304c45e-e1c0-4f76-83bd-fb48877ecc42 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:59.324437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 242/484] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:31:59.325722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f70d-c9d1-4ed2-9947-c3c5f949ca5e None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.326167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f70d-c9d1-4ed2-9947-c3c5f949ca5e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.326583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45f70d-c9d1-4ed2-9947-c3c5f949ca5e None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.328237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 243/485] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:31:59.342852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:59.345891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73c9b-9c80-4157-9751-2e83ad10c064 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.346329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73c9b-9c80-4157-9751-2e83ad10c064 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.346749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d73c9b-9c80-4157-9751-2e83ad10c064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.368170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:59.368819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.369097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.369365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.379747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-44d73c9b-9c80-4157-9751-2e83ad10c064 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:31:59.380990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-44d73c9b-9c80-4157-9751-2e83ad10c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:31:59.388227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:59.392948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:59.394058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:59.394869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 243/486] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:31:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:59.400249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:59.495110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:59.515957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 244/487] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:31:59.568951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8b287b-831c-4800-a0ee-75d62716c328 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:59.620517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:59.621345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.621796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.622210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.623015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:31:59.623468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:59.625011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:59.639094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 244/488] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:31:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:31:59.644783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d73c9b-9c80-4157-9751-2e83ad10c064 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:59.696609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:59.776622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:31:59.819349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d73c9b-9c80-4157-9751-2e83ad10c064 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:59.857225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:59.857859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.858145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.858419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.879187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:31:59.881189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:31:59.891125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa956e1-c9af-4474-838b-5942ed3d11b4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:31:59.901006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:59.901936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:31:59.902782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:31:59.902782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:31:59.902782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:31:59.904870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 245/489] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:59.910344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:59.928499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:31:59.929134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:31:59.929414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:31:59.929689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:31:59.941070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:31:59.947047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:31:59.947933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:31:59.948782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 245/490] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:31:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:31:59.949447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:31:59.962999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.022017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e1a40-2fe3-46be-9c1f-1efb95377593 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.056001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.057552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.058191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.058503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.058770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.060547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d39c1-04e4-41dd-b082-0b93325304fc None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.069473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:00.075109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:00.076008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:00.076849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:00.078202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 246/491] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:31:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:00.078749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.100464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458eb4f-85de-4cff-827c-1140536bad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.101068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458eb4f-85de-4cff-827c-1140536bad13 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.101389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458eb4f-85de-4cff-827c-1140536bad13 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.101614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458eb4f-85de-4cff-827c-1140536bad13 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.102291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458eb4f-85de-4cff-827c-1140536bad13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:00.102591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458eb4f-85de-4cff-827c-1140536bad13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.103944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458eb4f-85de-4cff-827c-1140536bad13 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.115554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 246/492] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:00.116740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc06d64-0eae-4327-a076-ace0e48358f1 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.117032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc06d64-0eae-4327-a076-ace0e48358f1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.117312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc06d64-0eae-4327-a076-ace0e48358f1 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.120306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 247/493] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:00.120306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc06d64-0eae-4327-a076-ace0e48358f1 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.194770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b19138-edcf-4bd5-a82f-970aea4ad267 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.197841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.227859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc06d64-0eae-4327-a076-ace0e48358f1 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.230821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.231428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.231708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.231985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.232680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:00.232985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.234380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.243815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 247/494] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:00.248285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.269015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606e0db-2012-40f5-8cae-99374cddea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.269624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e0db-2012-40f5-8cae-99374cddea3e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.269905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e0db-2012-40f5-8cae-99374cddea3e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.270186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606e0db-2012-40f5-8cae-99374cddea3e None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.271354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606e0db-2012-40f5-8cae-99374cddea3e None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:00.271828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606e0db-2012-40f5-8cae-99374cddea3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.274407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606e0db-2012-40f5-8cae-99374cddea3e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.281360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 248/495] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:00.282603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a078f-b486-4212-99a4-d50024406583 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.282964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a078f-b486-4212-99a4-d50024406583 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.283313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a078f-b486-4212-99a4-d50024406583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.305418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-817a078f-b486-4212-99a4-d50024406583 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:00.307199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-817a078f-b486-4212-99a4-d50024406583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:00.325773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.360075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8be2c8-dd98-4bc1-a3fd-cf2f05b660ce None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.383263 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 249/496] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:00.384397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a078f-b486-4212-99a4-d50024406583 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.405495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.407201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.407201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.407201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.420436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.421898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:00.434747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:00.435665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:00.436618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:00.440528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 248/497] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:00.441221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.470119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.503055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a078f-b486-4212-99a4-d50024406583 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.538022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e4579-50c3-40af-aea0-7d221055fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.538655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4579-50c3-40af-aea0-7d221055fe60 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.538941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4579-50c3-40af-aea0-7d221055fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.539219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e4579-50c3-40af-aea0-7d221055fe60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.546102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bed31d-cae2-479f-9ae6-eeb154beafb7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.548929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e4579-50c3-40af-aea0-7d221055fe60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.550387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e4579-50c3-40af-aea0-7d221055fe60 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-4a0e4579-50c3-40af-aea0-7d221055fe60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:00.564402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:00.565312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:00.566188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:00.566188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:00.566188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:00.566188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 250/498] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:00.566685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c46271-26e8-4bb2-a162-4ef6d06b4d68 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.566978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c46271-26e8-4bb2-a162-4ef6d06b4d68 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.567764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c46271-26e8-4bb2-a162-4ef6d06b4d68 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.573355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 251/499] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:00.574194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c46271-26e8-4bb2-a162-4ef6d06b4d68 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.577609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.587779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.588716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.589012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.589298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.599383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.600945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:00.615521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:00.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:00.617339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:00.617339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:00.617339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:00.617339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 249/500] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:00.617928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.685641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c46271-26e8-4bb2-a162-4ef6d06b4d68 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.699519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.718924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a941d-d54f-4e80-ad18-bf556bcb57a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.719535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a941d-d54f-4e80-ad18-bf556bcb57a3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.719822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a941d-d54f-4e80-ad18-bf556bcb57a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.720181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a941d-d54f-4e80-ad18-bf556bcb57a3 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.720560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0010-a87a-4fdf-b2e9-334912a6445f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.720907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a941d-d54f-4e80-ad18-bf556bcb57a3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:00.721220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a941d-d54f-4e80-ad18-bf556bcb57a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.722658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a941d-d54f-4e80-ad18-bf556bcb57a3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.753199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.753794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.754079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.754359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.755560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:00.755872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.757291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.759229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 252/501] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:00.760536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044368-96f4-4274-8da8-7ee18ff86c3d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.760834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044368-96f4-4274-8da8-7ee18ff86c3d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.761119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a044368-96f4-4274-8da8-7ee18ff86c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.774233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 250/502] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:00.775045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.782619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-1a044368-96f4-4274-8da8-7ee18ff86c3d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:00.783895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1a044368-96f4-4274-8da8-7ee18ff86c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:00.839171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.849649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 253/503] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:00.850438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044368-96f4-4274-8da8-7ee18ff86c3d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.874296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d90708-c2d6-4d96-adfa-1fe0d1be1a9f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.910100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.910809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.911087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.911375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:00.912021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:00.912394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:00.913772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:00.920704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:00.931238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 251/504] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:00.931238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:00.957325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a044368-96f4-4274-8da8-7ee18ff86c3d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:00.992717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:00.993389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:00.993926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:00.994098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.004584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:01.010394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:01.011262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:01.012054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 254/505] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:01.012747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.038694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825da75-6b3a-4228-b1c1-ec6439207b37 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.068943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.073193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.073837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.074112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.074348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.121742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b56d9-3290-4188-a6bc-6bc26c85f29e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.139375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.142921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.148418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.155672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.156323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.156604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.156877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.163657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.165123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:01.177460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:01.178430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 255/506] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:01.179320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.243017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 252/507] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:01.243777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.281768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816324-1b68-4710-833b-42611516dd09 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.293133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.315413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.316118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.316436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.316719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.325445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.326905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.337196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:01.338810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:01.339878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 256/508] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:01.354861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.355484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85af55-16a6-42e3-8f32-889d63ebb447 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.379140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.380255 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.380545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.380828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.381500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:01.381810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.383221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.391422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 253/509] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:01.392314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.438006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbd4d8-4049-4775-b955-6406cf2ff6c6 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.471963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.472616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.472907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.473184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.492462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.493993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.496198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c15d1-70a1-4dca-a919-c34bd66b51b8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:01.508306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:01.509227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:01.510069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:01.510069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:01.510069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:01.510069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 257/510] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:01.510290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.531267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.531941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.532260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.532545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.533284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:01.533604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.533774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.535066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.572178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 254/511] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:01.572178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.590694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.610465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9ad0c-910f-4ba0-bf61-9620e098130c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.645136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.645780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.646057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.646328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.656159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.657618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.668080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99aa840-3366-4a72-a4ef-213a695e0a42 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:01.671587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:01.672582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:01.673440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:01.673440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:01.673440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:01.673440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 258/512] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:01.673440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.704150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.704777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.705056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.705327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.706050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:01.706355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.707833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.724532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 255/513] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:01.725311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.748334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.774087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842d4f7-f58e-4612-b908-90b2cd807a50 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.799176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.807967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.808622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.808904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.809179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.819363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.820830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.821126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be80f6-c364-4578-b698-cd4487213145 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:01.834488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:01.835644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:01.841462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:01.841462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:01.841462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:01.841462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 259/514] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:01.841462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.856719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.857321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.857606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.857884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:01.858534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:01.858844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:01.860256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:01.871560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 256/515] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:01.872188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:01.940008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a491238-413b-4378-b6ee-1e84651a83e1 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.964346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:01.968511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15743e30-04f8-4818-8131-9b8ec5f974e7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:01.972744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:01.973339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:01.974158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:01.976994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.001488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.002135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.002451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.002731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.003380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:02.003690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.005387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.007648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.017770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 257/516] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:02.018554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.045089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.046554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.115482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199023e-faae-46cf-9e95-ab1aed05d713 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.143034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 260/517] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:02.143862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.147917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.148552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.148839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.149119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.173298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.210539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.216628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.218193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.245784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24299-201b-4c6c-9bf0-73968c4b4853 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.279537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.280063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.280376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.280649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.281290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:02.281597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.282963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.298201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 261/518] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:02.299057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.317595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 258/519] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:02.318434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.390750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.406152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047d1b3-8623-45e3-9ccc-fae913c61d02 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.409471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.415838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c241b-b3ba-459e-beb9-fd12e5d634c5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.439587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.440300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.440672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.440955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.441594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.443049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.448647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.449274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.449560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.449838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.456307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.458304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:02.470229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:02.471282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:02.472163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 259/520] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:02.472657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.523824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 262/521] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:32:02 2022] POST /identity/v3/users => generated 247 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:02.524690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.580852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90070dda-4761-4a63-8c00-c8dae2069e3f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.626741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.627390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.627675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.627956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.636918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5118727-0e5b-4c5b-8196-ddefccc27026 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.639932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.641498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:02.657853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:02.658825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:02.659818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:02.659818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:02.659818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:02.660736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 260/522] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:02.662287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.674492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.680168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.682498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.682498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.682498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.689582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.691089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:02.703371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:02.704414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 05:32:02.705319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:02.705818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 263/523] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:02.706474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.713720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.777648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d390-0755-4296-8535-c2cbebf61fd3 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.814044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.814679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.814961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.815234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.825576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.827034 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.828712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15047d-daa4-4677-bf3a-c1b064277aca None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:02.841077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:02.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:02.842907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:02.842907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:02.842907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:02.842907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 261/524] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:02.842907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.872233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.872596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.872875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.873150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.873848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:02.874156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.875586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.893253 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 264/525] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:02.893869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:02.917713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.957467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:02.960147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b038371-4280-464a-9aee-3d9a60ee2f1c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:02.995285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:02.995887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:02.996173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:02.996479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:02.997316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:02.997635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:02.999014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:02.999643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0da3ad-b510-4505-84a0-3fbb7c167bd0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.014895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 262/526] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:03.014895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.038838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.039450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.039732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.040005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.040772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:03.041080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.042520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.064038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 265/527] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Aug 22 05:32:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:03.064038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.119385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cd10f-d038-4d0d-a4db-50ffdbdffdbb None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.139697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:03.154486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.155101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.155386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.155662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.156343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:03.156650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.158070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.165408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc3245-1068-4576-8d64-e93eec1b35df None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.173516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 263/528] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:03.173516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.188186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:03.203531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.204143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.204450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.204733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.205491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=344aa2356f0c4d8fb88e7c35603a65c0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:03.205812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.207271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.213807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 266/529] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/role_assignments?user.id=344aa2356f0c4d8fb88e7c35603a65c0&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:03.214387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.302159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b2ed-c3ef-40b9-9c4c-7ccab763589b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.338579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340db8de-0fae-4e84-afa0-126f47f86f58 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.342642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.342642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.342877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.343076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.350984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.352664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:03.365045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:03.370742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 264/530] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:03.371820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.385789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.386544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.387187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.387685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.424671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:03.456948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:03.476714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.478518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.490486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964020fc-5f9c-4d6d-af52-7440219912de None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.526574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.527213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.527501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.527785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.534874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.536523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:03.548266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:03.549160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:03.550037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 265/531] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:03.550506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.597923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 267/532] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:03.599323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.655190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:03.657930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0935ab03-ba5e-4836-b916-c4e8338fbaf8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.693807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:03.696132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.697300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.698207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.698634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.699760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:03.700505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.702884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.710568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e27699-2128-4567-ac4c-3cf8e676798b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.729659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 266/533] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:03.731515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.760833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.761767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.762060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.762341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.763328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:03.763650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.765621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.785388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 268/534] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:03.785388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.848350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a04e-9591-4f69-be06-5465b7973cb7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.886217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.886851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.887262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.887514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.894501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c967e-6580-459e-afac-e34fc85474a7 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:03.898465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.899922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:03.915802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:03.916899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:03.917986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:03.917986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:03.917986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:03.921606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 267/535] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:03.922472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.934314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:03.935117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:03.935545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:03.936060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:03.936966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=38d2e7ee450e44299a99cba466545701) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:03.937422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:03.938665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:03.940177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:03.947761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 269/536] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/role_assignments?user.id=38d2e7ee450e44299a99cba466545701&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:03.956667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:03.975246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:04.046162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180b41-501d-44a8-bd29-394eab646a89 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:04.086444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:04.086846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:04.087204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:04.087560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:04.088265 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=a1af7582d3e94be1815574887e988e2c) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:04.088586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:04.090210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:04.096753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 268/537] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/role_assignments?user.id=a1af7582d3e94be1815574887e988e2c&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:04.162865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f782b5e-d0b6-4735-9f69-39913286a2c4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:04.202190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:04.202801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:04.203089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:04.203369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:04.204100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:04.204444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:04.205869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:04.220666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 270/538] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:04.226366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:04.320619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:04.341180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3159c3-de63-4a10-a02c-37a727f5ece4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:04.380029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:04.380806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:04.381094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:04.381376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:04.388972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:04.390515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:04.402642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:04.403689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:04.404815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 269/539] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:04.409840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:04.482219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:04.517765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73118ecc-9eb4-4442-8cfc-d334c19999e4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:04.553678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcb401-5d66-4f4b-ab0a-f97249278350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:04.554294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb401-5d66-4f4b-ab0a-f97249278350 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:04.554580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb401-5d66-4f4b-ab0a-f97249278350 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:04.554861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcb401-5d66-4f4b-ab0a-f97249278350 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:04.555607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcb401-5d66-4f4b-ab0a-f97249278350 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:04.556014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcb401-5d66-4f4b-ab0a-f97249278350 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:04.557604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fcb401-5d66-4f4b-ab0a-f97249278350 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:04.570298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 271/540] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:04.576220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:04.604546 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a26a-bd4e-4d02-8528-409e9457a254 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:04.604829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a26a-bd4e-4d02-8528-409e9457a254 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:04.605134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80a26a-bd4e-4d02-8528-409e9457a254 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:04.606529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 272/541] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:32:04.611580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf24ac-0ab0-4dc3-8d13-3ccf3200d0fe None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:04.611872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf24ac-0ab0-4dc3-8d13-3ccf3200d0fe None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:04.612155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf24ac-0ab0-4dc3-8d13-3ccf3200d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:04.651689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-70cf24ac-0ab0-4dc3-8d13-3ccf3200d0fe None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:04.652937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-70cf24ac-0ab0-4dc3-8d13-3ccf3200d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:04.734012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 273/542] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:32:04.790586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7eef58-5763-42c2-8f53-adf0e841db20 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:04.841504 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c38d1-82b3-4100-9cc1-c05eabc84822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:04.842111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c38d1-82b3-4100-9cc1-c05eabc84822 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:04.842393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c38d1-82b3-4100-9cc1-c05eabc84822 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:04.842675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c38d1-82b3-4100-9cc1-c05eabc84822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:04.843403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c38d1-82b3-4100-9cc1-c05eabc84822 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=2d46d5905b004073b10e694ab79e7187) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:04.843713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c38d1-82b3-4100-9cc1-c05eabc84822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:04.845184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c38d1-82b3-4100-9cc1-c05eabc84822 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:04.848011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:04.850994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 270/543] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:04 2022] GET /identity/v3/role_assignments?user.id=2d46d5905b004073b10e694ab79e7187&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:05.132547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf24ac-0ab0-4dc3-8d13-3ccf3200d0fe None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:05.198122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:05.253038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf24ac-0ab0-4dc3-8d13-3ccf3200d0fe None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:05.355608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:05.356621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:05.357083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:05.357536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:05.376554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:05.377577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191bb5f-6a0b-43ef-8237-b82346c2b618 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:05.377866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191bb5f-6a0b-43ef-8237-b82346c2b618 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:05.378150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191bb5f-6a0b-43ef-8237-b82346c2b618 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:05.379755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 271/544] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:05.382653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:05.383728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:05.384714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:05.385468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b948-c717-42b4-9446-792c7a9e350a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:05.385468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b948-c717-42b4-9446-792c7a9e350a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:05.385468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97b948-c717-42b4-9446-792c7a9e350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:05.386860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 274/545] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:05.392608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:05.424506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-7a97b948-c717-42b4-9446-792c7a9e350a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:05.426740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7a97b948-c717-42b4-9446-792c7a9e350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:05.549817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae987b86-b636-4cf7-a0eb-9d16801367c8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:05.570658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:05.578514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 272/546] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:32:05.589594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:05.590376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:05.590843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:05.591263 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:05.592072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:05.592564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:05.594067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:05.602573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 275/547] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:05.610299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97b948-c717-42b4-9446-792c7a9e350a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:05.760957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97b948-c717-42b4-9446-792c7a9e350a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:05.803622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:05.810045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:05.810680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:05.810963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:05.811247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:05.826393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:05.827863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:05.847973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:05.849237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:05.850489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:05.850489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:05.850489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:05.850489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 273/548] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:05.854867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:05.914771 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:06.054415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67959b0c-74fb-490a-b6fd-ff4e6a02fe42 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:06.063868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1123c390-ac97-4264-be05-3e21b325c94b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:06.107410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:06.108048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.108593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.108743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.126786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:06.127409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.127694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.127971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.128647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:06.128955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:06.130922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:06.134604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:06.141740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:06.142811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:06.144261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 274/549] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:06.150848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:06.163110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 276/550] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:06.169132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:06.222410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:06.254179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:06.314329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c7130-c91a-4fd8-be9e-10b7821a0cfe None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:06.356639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ecbfa-705e-43ff-98f3-436804bc9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:06.357279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ecbfa-705e-43ff-98f3-436804bc9419 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.357563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ecbfa-705e-43ff-98f3-436804bc9419 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.357837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ecbfa-705e-43ff-98f3-436804bc9419 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.374575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ecbfa-705e-43ff-98f3-436804bc9419 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:06.376036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ecbfa-705e-43ff-98f3-436804bc9419 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:06.396755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d80cbe-7c4c-4939-be6a-15420f71555d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c31ecbfa-705e-43ff-98f3-436804bc9419 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:06.402423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:06.403482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:06.404431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:06.415832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 277/551] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:06.417567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf56f9-65e1-4de8-b403-021ca425bc12 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.418066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf56f9-65e1-4de8-b403-021ca425bc12 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.418549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf56f9-65e1-4de8-b403-021ca425bc12 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.420765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 278/552] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:06.422222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a385fc7-4b34-4ed5-9612-355b13aaa520 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.422831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a385fc7-4b34-4ed5-9612-355b13aaa520 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.423311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a385fc7-4b34-4ed5-9612-355b13aaa520 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.424917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 279/553] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:06.425832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a385fc7-4b34-4ed5-9612-355b13aaa520 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:06.444826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b873c-b838-456f-a05f-632996cfc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:06.445480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b873c-b838-456f-a05f-632996cfc303 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.445770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b873c-b838-456f-a05f-632996cfc303 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.446043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b873c-b838-456f-a05f-632996cfc303 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.446719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b873c-b838-456f-a05f-632996cfc303 None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:06.447031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b873c-b838-456f-a05f-632996cfc303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:06.448465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b873c-b838-456f-a05f-632996cfc303 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:06.460244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 275/554] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:06.460244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c9c7-8612-4b8c-838d-d805a727be2c None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.460244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c9c7-8612-4b8c-838d-d805a727be2c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.460244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8c9c7-8612-4b8c-838d-d805a727be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.479879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1bc8c9c7-8612-4b8c-838d-d805a727be2c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:06.481116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1bc8c9c7-8612-4b8c-838d-d805a727be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:06.533200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:06.538291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a385fc7-4b34-4ed5-9612-355b13aaa520 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:06.555086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 276/555] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:06.556697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f73aa-c52b-4934-ab77-ae12f201d953 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.557945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f73aa-c52b-4934-ab77-ae12f201d953 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.558244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f73aa-c52b-4934-ab77-ae12f201d953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.576724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-841f73aa-c52b-4934-ab77-ae12f201d953 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:06.577867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-841f73aa-c52b-4934-ab77-ae12f201d953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:06.578245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:06.579077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.579582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.580348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.582374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:06.582908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:06.584586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:06.607667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:06.610532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 280/556] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Aug 22 05:32:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:06.611635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:06.668381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 277/557] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:06.668381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f73aa-c52b-4934-ab77-ae12f201d953 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:06.770896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cfb02-ee20-458a-81ea-66352191f3a9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:06.816670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:06.817343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.817628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.817905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.838506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:06.840777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:06.862872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:06.864445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:06.865423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:06.865423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:06.865423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:06.865591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f73aa-c52b-4934-ab77-ae12f201d953 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:06.868346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 281/558] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:06.870109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:06.887619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:06.905623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:06.906373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:06.906760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:06.907139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:06.941110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:06.992250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:06.993842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:06.998578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2c1f4-aa26-4c8a-8ae1-68c5e5a4eecf None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.041107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.042001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.042283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.042788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.055823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:07.061643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:07.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:07.064327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:07.067636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 282/559] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:07.068491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.102887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 278/560] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:07.102887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.140254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.160563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.169879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc47b3-b60c-4d3a-8238-38879f143fe9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.197329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825736e0-6097-4d47-b109-c55d85d08cba None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.202517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.203115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.203395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.203668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.204333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:07.204641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.206016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.217690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 283/561] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:07.218465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.231574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.232219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.232514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.232791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.243270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:07.248471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:07.253440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 279/562] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:07.254319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.351604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ffd51-f772-4a7d-bd78-de21c653f84b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.351777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394025c-9f7c-4080-bd05-dcb97537d56e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.374309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.381406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.384343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.384960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.385248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.385522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.386578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf1b74-de35-4d32-abb1-4b1248d0611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.387187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1b74-de35-4d32-abb1-4b1248d0611c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.387464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1b74-de35-4d32-abb1-4b1248d0611c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.387739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf1b74-de35-4d32-abb1-4b1248d0611c None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.388434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf1b74-de35-4d32-abb1-4b1248d0611c None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:07.391946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf1b74-de35-4d32-abb1-4b1248d0611c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.391946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf1b74-de35-4d32-abb1-4b1248d0611c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.395283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.396759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.397748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 284/563] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:07.398881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4358-1664-48da-81b2-145e2172a4e7 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.399170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4358-1664-48da-81b2-145e2172a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.399488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4358-1664-48da-81b2-145e2172a4e7 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.400694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 285/564] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:07.401377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d4358-1664-48da-81b2-145e2172a4e7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:07.412903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:07.417318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:07.418421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:07.418421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:07.418421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:07.418421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 280/565] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:07.418421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.506235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d4358-1664-48da-81b2-145e2172a4e7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.514293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615043d0-5498-42c1-9cb2-93ae95669f15 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.540216 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be25f3-e6d4-45d9-a195-67a650bc9033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.540849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be25f3-e6d4-45d9-a195-67a650bc9033 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.541131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be25f3-e6d4-45d9-a195-67a650bc9033 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.541403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be25f3-e6d4-45d9-a195-67a650bc9033 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.547587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.548180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.548494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.548772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.548987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be25f3-e6d4-45d9-a195-67a650bc9033 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.549434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:07.549741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.550437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70be25f3-e6d4-45d9-a195-67a650bc9033 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.551086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.559168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 281/566] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:07.559868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-70be25f3-e6d4-45d9-a195-67a650bc9033 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:07.561247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:07.562162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:07.563130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 286/567] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:07.563743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76e0aa-47c0-45f2-87e7-d32da48c47a9 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.563743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76e0aa-47c0-45f2-87e7-d32da48c47a9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.564381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76e0aa-47c0-45f2-87e7-d32da48c47a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.581596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0c76e0aa-47c0-45f2-87e7-d32da48c47a9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:07.583296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0c76e0aa-47c0-45f2-87e7-d32da48c47a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:07.601106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.630940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.649935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 287/568] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:07.650898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76e0aa-47c0-45f2-87e7-d32da48c47a9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.661825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1161-86a8-4048-af6a-8643420a4f7b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.696047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.696722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.696992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.697272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.711147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.712646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:07.727967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:07.729109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:07.730011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:07.730011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:07.730011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:07.730011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 282/569] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:07.730011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.761977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76e0aa-47c0-45f2-87e7-d32da48c47a9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.797773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.798388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.798673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.798949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.799601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:07.799908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.801345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.813417 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 288/570] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:07.814049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.829719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.841087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418340c2-7e32-46df-98fb-1c46d26772b5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.858635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:07.876579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.877228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.877510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.877785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.888923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.890376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:07.906353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:07.907293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:07.908226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:07.908226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:07.908226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:07.908226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 283/571] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:07.908466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:07.921290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b9d32-3922-4610-a56c-50c4f54a1283 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:07.954847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:07.955446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:07.955736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:07.956014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:07.956775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:07.957088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:07.959175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:07.976177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 289/572] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:07.976989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.007019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd394d68-12b1-4846-947b-2e294316f90c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.039647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.040268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.040557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.040837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.041480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:08.041791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.043154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.054524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 284/573] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:08.055316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.057917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.073594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.076356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d589e-c351-4254-93eb-eadcb628d107 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.109527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.110154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.110439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.110714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.117289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.118718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:08.131083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:08.132003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:08.132920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 290/574] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:08.133399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.158653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a13587-d05e-4029-b3e2-2fc3fac65bd2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.193676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.194279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.194566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.194844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.195489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:08.195797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.197209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.207978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 285/575] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:08.208787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.236950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23714721-d99d-4c4f-98c5-15d69eed73f1 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.268946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.270778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.271421 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.271719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.271994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.281966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:08.286709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:08.287644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 291/576] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:08.289640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.327920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.340796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48930ea1-2a4f-4e44-bab5-45ce61f09c76 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.373562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.374187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.374472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.374753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.385497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.386940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:08.400536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:08.401656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:08.402562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:08.402562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:08.402562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:08.402562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 286/577] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:08.403093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.409205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743b48b-c971-4350-817b-f5c375b962cb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.442908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.443532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.443813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.444086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.450889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.452377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:08.463694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:08.464782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 292/578] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:08.465766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.506126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53115a5-db70-41f6-821e-1998a1faab29 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.519119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.538837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.539443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.539726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.540001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.540728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:08.541282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.542463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.544965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.554784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 287/579] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:08.557646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.563689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240031e-3dc5-49ea-8f20-0321d67deec2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.598658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.599335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.599620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.599905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.606809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.608273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:08.619827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:08.620872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 293/580] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:08.621813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.658380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d31eb3-56e4-4f75-8c83-8686614d39aa None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.692830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.693363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.693650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.693928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.694587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:08.694890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.696290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.703926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 288/581] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:08.704723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.719571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd69eb-6db4-48a0-ade8-fce232715b25 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.740738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.754064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.755227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.755510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.755792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.756470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:08.756783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.758149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.767358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.771112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 294/582] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:08.772034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.804272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e09f8-e10d-4628-82fb-cfbad05cdfad None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.837837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.838553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.838890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.839173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.839898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:08.840232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.841660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.857960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 289/583] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:08.858736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.874464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531880d-c794-471e-990d-de85cb5f6be0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.908295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:08.908889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:08.909167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:08.909439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:08.910160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=9800dbdc23794d9eb02e3c2002b096b2) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:08.910511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:08.911949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:08.917114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 295/584] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/role_assignments?user.id=9800dbdc23794d9eb02e3c2002b096b2&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:08.917868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:08.959207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:08.966803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f3214-d0b9-48b3-aa26-6142566a7fac None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:08.999329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:09.007296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.009436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.009436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.009436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.009436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:09.009770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.010971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.032029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 290/585] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:09.032904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.048700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98fae-f872-4d70-b6ce-776dbb4a4180 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.093236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.093870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.094149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.094423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.105500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.107018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:09.121219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:09.122375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:09.123291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:09.123291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:09.123291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:09.123291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 296/586] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:09.123555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.147675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd124049-69a1-4cf0-8b90-3de234a73eaa None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.185035 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.185664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.185952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.186232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.193556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.195010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:09.206153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:09.207078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 291/587] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:09.209011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.225635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:09.232259 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21514d-fadf-4bff-b869-28a0d7f069b9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.249731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:09.267441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.268066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.268378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.268677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.279552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.281025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:09.301909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:09.302874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:09.303779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:09.303779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:09.303779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:09.303779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 297/588] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:09.303779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.325874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8e089-a996-43bf-85d8-d1573fea8e02 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.362138 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.362765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.363045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.363330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.374961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.376431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:09.391134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:09.392133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:09.393047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:09.393047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:09.393047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:09.397732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 292/589] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:09.398349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.416222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88101f-1161-490a-8dec-72f21e9d6003 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.453185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.453793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.454076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.454351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.454999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:09.455307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.456728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.462744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:09.474418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 298/590] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:09.474418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.503932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:09.507134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2fff-052c-4310-a4c4-a6261d4cb372 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.541692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.542304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.542591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.542888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.543587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:09.543904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.545372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.557850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 293/591] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:09.558635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.589766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc538c4d-1c1f-4b47-8f9f-5b24f0d317c4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.628254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.629912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.630345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.630766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.631549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:09.632024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.634079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.648990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 299/592] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:09.650659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.658638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b95ec-2c9a-4d2c-b191-c48d10b95038 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.683445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:09.694416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.695272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.695799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.696078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.696761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:09.697073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.698435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.715149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 294/593] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:09.715149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.763508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:09.775141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1517c15-9abe-4f30-87e0-10a53b70b492 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.818663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.819537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.819818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.820094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.824020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73f17f-1147-444f-a877-3a356007dbb0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.827518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.829023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:09.841517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:09.842474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 300/594] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:09.843412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.865045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.865807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.866190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.866547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/344aa2356f0c4d8fb88e7c35603a65c0/roles/61ca3da5b31d4366a080ece9048a5ba8` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.883336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=344aa2356f0c4d8fb88e7c35603a65c0, role_id=61ca3da5b31d4366a080ece9048a5ba8)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.884832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:09.943067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459330b6-ec37-4abb-a802-898d1fd237d5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:09.965084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 295/595] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:09 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/344aa2356f0c4d8fb88e7c35603a65c0/roles/61ca3da5b31d4366a080ece9048a5ba8 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:09.966210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:09.987765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:09.988572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:09.988807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:09.989087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:09.997579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:09.999167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:10.011799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:10.012828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:10.013782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:10.017845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 301/596] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:10.018785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.028594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.032420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.116781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb414d-1283-44d9-a559-f415ab4a6a82 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.133053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6733b-862f-4fd9-a03b-d637bb26b07b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.167735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.169376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.169741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.169937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.179335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.180867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.181786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.182919 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.183819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.184342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.185281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:10.185814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.187848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:10.192848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:10.193731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 296/597] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:10.195146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.214400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 302/598] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Aug 22 05:32:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:10.215858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.293772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.330084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b6af0-414b-454c-8110-a0e8056da487 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.337378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.347166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb1d8a-c3e2-4ac3-9d6b-a1595e557d91 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.367683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.368377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.368658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.368934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.369680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:10.369992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.371524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.384610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 303/599] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:10.390469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.392741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.393858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.395909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.396416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.397320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:10.397830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.399483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.417058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 297/600] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:10.418797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.504957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c174-0f7e-4d7b-8402-6cd5d7fbf10b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.530554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6347afe-6a44-4127-a54d-c892dee0912e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.532079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.543599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.543599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.543599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.543599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.556241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.557970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.567964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.568667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.568943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.569237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/a1af7582d3e94be1815574887e988e2c/roles/61ca3da5b31d4366a080ece9048a5ba8` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:10.574476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:10.575403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:10.576503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:10.576503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:10.576503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:10.582883 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 304/601] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:10.584028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.584333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=a1af7582d3e94be1815574887e988e2c, role_id=61ca3da5b31d4366a080ece9048a5ba8)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.586114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.660247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 298/602] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:10 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/a1af7582d3e94be1815574887e988e2c/roles/61ca3da5b31d4366a080ece9048a5ba8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:10.660247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.660247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.750430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796de686-71b3-4aaf-a041-993fbac1b49e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.783091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590fdfe-a773-458d-85f0-5825f63ce552 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.832962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f70a5-e8b3-4fcc-85ec-632edfcff6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.833522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f70a5-e8b3-4fcc-85ec-632edfcff6ab None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.833847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f70a5-e8b3-4fcc-85ec-632edfcff6ab None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.834132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f70a5-e8b3-4fcc-85ec-632edfcff6ab None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.835098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f70a5-e8b3-4fcc-85ec-632edfcff6ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:10.835367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f70a5-e8b3-4fcc-85ec-632edfcff6ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.836787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f70a5-e8b3-4fcc-85ec-632edfcff6ab None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.837457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955a587-f204-4eeb-beaa-987bce66b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:10.838147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a587-f204-4eeb-beaa-987bce66b61a None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.838506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a587-f204-4eeb-beaa-987bce66b61a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.838701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955a587-f204-4eeb-beaa-987bce66b61a None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/38d2e7ee450e44299a99cba466545701/roles/61ca3da5b31d4366a080ece9048a5ba8` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.850555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 299/603] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:10.851819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f890-f18d-421e-924c-129ef0cd6cb8 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.852115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f890-f18d-421e-924c-129ef0cd6cb8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.852435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2f890-f18d-421e-924c-129ef0cd6cb8 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.854027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 300/604] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:10.857892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2f890-f18d-421e-924c-129ef0cd6cb8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:10.862289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955a587-f204-4eeb-beaa-987bce66b61a None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=38d2e7ee450e44299a99cba466545701, role_id=61ca3da5b31d4366a080ece9048a5ba8)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:10.864702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955a587-f204-4eeb-beaa-987bce66b61a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:10.922899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:10.957635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 305/605] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:10 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/38d2e7ee450e44299a99cba466545701/roles/61ca3da5b31d4366a080ece9048a5ba8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:10.962129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301421-055a-4f36-aec4-57f8d4c77c88 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:10.962129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301421-055a-4f36-aec4-57f8d4c77c88 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:10.962129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82301421-055a-4f36-aec4-57f8d4c77c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:10.982489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2f890-f18d-421e-924c-129ef0cd6cb8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:10.997857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-82301421-055a-4f36-aec4-57f8d4c77c88 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:10.999084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-82301421-055a-4f36-aec4-57f8d4c77c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:11.045251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:11.049973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:11.050754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:11.051717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:11.051997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:11.062537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:11.062537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:11.075841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:11.076964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:11.078066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:11.082230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 301/606] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:11.097008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:11.120450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 306/607] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:11.227178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b696f-6b4d-4f79-932a-7136310d6bde None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:11.251206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:11.263345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:11.263953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:11.264256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:11.264537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:11.265247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:11.265561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:11.267005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:11.280978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 302/608] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:11.287382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301421-055a-4f36-aec4-57f8d4c77c88 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:11.430152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82301421-055a-4f36-aec4-57f8d4c77c88 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:11.459140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:11.465391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:11.466061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:11.466345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:11.466621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/2d46d5905b004073b10e694ab79e7187/roles/61ca3da5b31d4366a080ece9048a5ba8` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:11.498908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=2d46d5905b004073b10e694ab79e7187, role_id=61ca3da5b31d4366a080ece9048a5ba8)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:11.504391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:11.586832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 307/609] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:11 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/2d46d5905b004073b10e694ab79e7187/roles/61ca3da5b31d4366a080ece9048a5ba8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:32:11.599146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12572b-728e-4611-bf07-8bf0c1923a44 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:11.649103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:11.649774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:11.650059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:11.650387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:11.665532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:11.670467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:11.671440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:11.672317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:11.675542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 303/610] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:11.678152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:11.692685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:11.807092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5ed8-d198-4a24-8c60-1892ef97630b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:11.845336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:11.845949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:11.846231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:11.846509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:11.847190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:11.847499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:11.848936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:11.860439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 308/611] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:11.866414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:11.932134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:12.006029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2406e26f-4570-4834-8750-397aca242c9c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:12.048537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:12.049519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:12.050003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:12.050934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:12.066369 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:12.068152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:12.086171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:12.087139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:12.088016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:12.088016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:12.088016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:12.089886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 304/612] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:12.095655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:12.180019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:12.226479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9496afe-1db8-4be0-9eef-e98656915193 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:12.270485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea32d3-c4eb-427d-a98a-f923b1bbfb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:12.271022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea32d3-c4eb-427d-a98a-f923b1bbfb89 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:12.271304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea32d3-c4eb-427d-a98a-f923b1bbfb89 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:12.271581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea32d3-c4eb-427d-a98a-f923b1bbfb89 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:12.272259 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea32d3-c4eb-427d-a98a-f923b1bbfb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:12.272566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea32d3-c4eb-427d-a98a-f923b1bbfb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:12.273955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea32d3-c4eb-427d-a98a-f923b1bbfb89 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:12.287075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 309/613] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:12.299805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:12.396213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427887a-7c4a-4261-a3ef-cb72aae0d3b3 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:12.396631 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427887a-7c4a-4261-a3ef-cb72aae0d3b3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:12.396817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427887a-7c4a-4261-a3ef-cb72aae0d3b3 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:12.398235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 310/614] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:12.403301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5be7be-acbc-4d86-98d6-fa4de60f91ca None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:12.403806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5be7be-acbc-4d86-98d6-fa4de60f91ca None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:12.404316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5be7be-acbc-4d86-98d6-fa4de60f91ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:12.439382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fc5be7be-acbc-4d86-98d6-fa4de60f91ca None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:12.441464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fc5be7be-acbc-4d86-98d6-fa4de60f91ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:12.442055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:12.451098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05644522-5a68-4b1c-b87f-ca4b7223bfdb None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:12.484446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:12.485087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:12.485353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:12.485630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:12.493351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:12.494793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:12.508620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:12.509551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:12.510482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:12.516590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 305/615] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:12.517459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:12.593724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 311/616] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 22 05:32:12.649644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b172119-dfcb-40b2-9bb7-c0d910a45eb2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:12.703271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:12.703884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:12.704167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:12.704470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:12.705211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:12.705522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:12.706974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:12.732323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 306/617] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Aug 22 05:32:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:12.737898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5be7be-acbc-4d86-98d6-fa4de60f91ca None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:12.809727 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:12.862420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5be7be-acbc-4d86-98d6-fa4de60f91ca None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:12.906335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:12.906974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:12.907258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:12.907531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:12.917662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:12.919106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:12.933967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:12.934953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:12.935848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:12.935848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:12.935848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:12.935848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 312/618] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:12.938213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:12.947898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:12.971149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.057527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2bcc1-3cde-4e5a-a7a9-8f9d191d3a3b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.082714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f20b02-3edb-4674-8c54-6f8d6b4b9568 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.092336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd4953-9f72-4003-9a7d-676eb60f12c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.092990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4953-9f72-4003-9a7d-676eb60f12c7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.093274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4953-9f72-4003-9a7d-676eb60f12c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.093552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4953-9f72-4003-9a7d-676eb60f12c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.100679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.106377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd4953-9f72-4003-9a7d-676eb60f12c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-87cd4953-9f72-4003-9a7d-676eb60f12c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:13.111339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:13.112308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:13.113230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 307/619] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:13.120279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687bfd2-b4df-4ad6-9476-c5ed38f3a27a None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.120279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687bfd2-b4df-4ad6-9476-c5ed38f3a27a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.120279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687bfd2-b4df-4ad6-9476-c5ed38f3a27a None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.120279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 308/620] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:13.120279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687bfd2-b4df-4ad6-9476-c5ed38f3a27a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.136291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45cec5-41e9-46d9-9175-3a9457fe2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.138745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cec5-41e9-46d9-9175-3a9457fe2d5b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.138745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cec5-41e9-46d9-9175-3a9457fe2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.138745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45cec5-41e9-46d9-9175-3a9457fe2d5b None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.138745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cec5-41e9-46d9-9175-3a9457fe2d5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:13.139250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cec5-41e9-46d9-9175-3a9457fe2d5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:13.141084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45cec5-41e9-46d9-9175-3a9457fe2d5b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:13.154433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 313/621] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:13.156055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa512-1eff-4ce6-ad7f-8a627a10a510 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.156699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa512-1eff-4ce6-ad7f-8a627a10a510 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.157178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fa512-1eff-4ce6-ad7f-8a627a10a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.177045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f83fa512-1eff-4ce6-ad7f-8a627a10a510 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:13.178780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f83fa512-1eff-4ce6-ad7f-8a627a10a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:13.205188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.232988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687bfd2-b4df-4ad6-9476-c5ed38f3a27a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.260450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 314/622] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:13.261789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa512-1eff-4ce6-ad7f-8a627a10a510 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.270701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.271364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.271649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.271978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.275646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:13.275646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:13.275646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:13.290659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 309/623] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:13.290858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.397692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5eebc7-00f4-4cad-8999-4f881c51464e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.415800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fa512-1eff-4ce6-ad7f-8a627a10a510 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.417763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.433052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831aa9-5e6f-4a4c-9120-22a6e9618750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.433925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831aa9-5e6f-4a4c-9120-22a6e9618750 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.434378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831aa9-5e6f-4a4c-9120-22a6e9618750 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.434801 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831aa9-5e6f-4a4c-9120-22a6e9618750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.447324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831aa9-5e6f-4a4c-9120-22a6e9618750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:13.449228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831aa9-5e6f-4a4c-9120-22a6e9618750 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:13.449947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.463220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab075dcc-a9ce-4110-8909-2163c0821eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.463924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab075dcc-a9ce-4110-8909-2163c0821eef None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.464308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab075dcc-a9ce-4110-8909-2163c0821eef None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.464525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab075dcc-a9ce-4110-8909-2163c0821eef None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-a0831aa9-5e6f-4a4c-9120-22a6e9618750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:13.469970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:13.471097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:13.472245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:13.472245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:13.472245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:13.472456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab075dcc-a9ce-4110-8909-2163c0821eef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:13.473001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab075dcc-a9ce-4110-8909-2163c0821eef None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:13.474396 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 310/624] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:13.475877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921109e-a1e2-4bf9-a1bb-302f1ecd3d14 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.476342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921109e-a1e2-4bf9-a1bb-302f1ecd3d14 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.476760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921109e-a1e2-4bf9-a1bb-302f1ecd3d14 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.482519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 311/625] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:13.483473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921109e-a1e2-4bf9-a1bb-302f1ecd3d14 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-ab075dcc-a9ce-4110-8909-2163c0821eef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:13.491420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:13.492564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:13.493791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:13.496357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 315/626] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:13.497818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c68404-d6ee-444b-8be7-b59239771135 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.498058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c68404-d6ee-444b-8be7-b59239771135 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.498348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c68404-d6ee-444b-8be7-b59239771135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.519114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-77c68404-d6ee-444b-8be7-b59239771135 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:13.520395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-77c68404-d6ee-444b-8be7-b59239771135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:13.593033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 316/627] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:13.593742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c68404-d6ee-444b-8be7-b59239771135 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.607182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921109e-a1e2-4bf9-a1bb-302f1ecd3d14 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.656511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.658008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.658647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.659134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.661208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:13.661729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:13.663608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:13.680940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 312/628] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:13.682216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.697366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.706572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c68404-d6ee-444b-8be7-b59239771135 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.744860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.751983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.753287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.754051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.754500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.755832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:13.756478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:13.758864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:13.775227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 317/629] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:13.776364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.803765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1695a790-9946-4843-bd03-0f92d9f5eaa3 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.840368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.841000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.841278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.841855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.852243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:13.857155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:13.858125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:13.859054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:13.863162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 313/630] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:13.864040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.905022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd0256-bfb5-4b6a-b1ce-ba7197d577e0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.939700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:13.940343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:13.940565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:13.940840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:13.949610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:13.951053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:13.963055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:13.964247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 318/631] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:13.965502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:13.975890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5745e-67ec-443f-8a52-7a6f8a57ce96 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:13.981029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:13.985121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.008917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.009577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.009864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.010144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/9800dbdc23794d9eb02e3c2002b096b2/roles/61ca3da5b31d4366a080ece9048a5ba8` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.024652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=9800dbdc23794d9eb02e3c2002b096b2, role_id=61ca3da5b31d4366a080ece9048a5ba8)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.026113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.065014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7fe24-4d1a-43ce-9218-070b01ae9d68 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.088525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 314/632] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:13 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/9800dbdc23794d9eb02e3c2002b096b2/roles/61ca3da5b31d4366a080ece9048a5ba8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:14.089492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.101790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe7224-fdb7-464d-890e-af80a7fb1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.102424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7224-fdb7-464d-890e-af80a7fb1524 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.102717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7224-fdb7-464d-890e-af80a7fb1524 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.102996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe7224-fdb7-464d-890e-af80a7fb1524 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.103702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7224-fdb7-464d-890e-af80a7fb1524 None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:14.104014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7224-fdb7-464d-890e-af80a7fb1524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.105505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe7224-fdb7-464d-890e-af80a7fb1524 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.114739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 319/633] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:14.116009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff71d-4cc9-4c8b-9c11-e4e225f81545 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.116346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff71d-4cc9-4c8b-9c11-e4e225f81545 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.116626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff71d-4cc9-4c8b-9c11-e4e225f81545 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.117959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 320/634] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:14.118501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bff71d-4cc9-4c8b-9c11-e4e225f81545 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.205543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.215747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6c3f1-03d3-4e04-accb-9b2071f3c237 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.236881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bff71d-4cc9-4c8b-9c11-e4e225f81545 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.259957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.260632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.260920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.261191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.271989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:14.274891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f34c9-0071-43ad-a110-56a54aaf195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.275501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f34c9-0071-43ad-a110-56a54aaf195c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.275784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f34c9-0071-43ad-a110-56a54aaf195c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.276056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f34c9-0071-43ad-a110-56a54aaf195c None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:14.276778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:14.277679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:14.280982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:14.281627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f34c9-0071-43ad-a110-56a54aaf195c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:14.281627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f34c9-0071-43ad-a110-56a54aaf195c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.281755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 315/635] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:14.281831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f34c9-0071-43ad-a110-56a54aaf195c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.281900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.303980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 321/636] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:14.305188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabbee1-6b21-4a11-b689-7eab911a8f82 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.305586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabbee1-6b21-4a11-b689-7eab911a8f82 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.305867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabbee1-6b21-4a11-b689-7eab911a8f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.309726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.325451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-caabbee1-6b21-4a11-b689-7eab911a8f82 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:14.326816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-caabbee1-6b21-4a11-b689-7eab911a8f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:14.400231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 322/637] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:14.400881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabbee1-6b21-4a11-b689-7eab911a8f82 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.413060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64dd5-b891-4fb8-b6e1-5185ed87af0b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.468558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.470492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.471419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.471871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.472321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.486710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.488460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:14.508726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:14.509923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:14.511024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:14.511024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:14.511024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:14.513496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 316/638] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:14.514544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.523752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabbee1-6b21-4a11-b689-7eab911a8f82 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.560318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.561078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.561457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.561839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.562588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:14.562992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.564599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.578332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 323/639] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:14.579437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.595547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.627493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55a328-5fa6-4431-946e-b287439698ad None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.667476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.668114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.668439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.668719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.702737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa921fc-8e2d-488b-860f-576559f60f21 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.727981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.738580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.742059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.742059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.742059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.742059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:14.742059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.742418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.742510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.742583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.758407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 324/640] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:14.758407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.821108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.857358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 317/641] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:14.858239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.859136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed1a73-fcc7-4622-86b6-4281f80654da None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:14.893654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:14.894281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:14.895103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:14.895393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:14.905139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:14.906589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:14.921331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:14.922305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:14.923225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:14.923225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:14.923225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:14.923225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 325/642] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:14.923225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:14.970071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:14.979692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb8442-7541-4a82-94a4-43236bc685da None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.020586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.021223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.021513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.021797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.032428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:15.037264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:15.038282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 318/643] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:15.039148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.040970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5b64b-1c73-4b86-ba44-f1904da797cd None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.078102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.078307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.078829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.079119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.079389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.087167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.088827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:15.100375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:15.101353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 326/644] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:15.107730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.159460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43e7f2-401d-4e20-970b-a16c4e7eb45f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.203430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.204072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.204388 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.204669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.206185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.213460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbd31a-db0d-4ba6-94c3-b04dee24384b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.216669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.217316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:15.232136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:15.233275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:15.234522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:15.234522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:15.234522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:15.234522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 319/645] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:15.234522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.256004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.256869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.257154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.257434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.258085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:15.258396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.259987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.272449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 327/646] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:15.273064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.332607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.351520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af360f8c-08fa-4e33-926d-9df4cf55cd5c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.380031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c562a7-9199-4c9a-8fc9-254702aa2203 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.395149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.395800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.396091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.396557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.397529 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:15.397848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.399221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.408039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 320/647] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:15.408869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.418065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.418787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.419167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.419552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.420415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:15.420824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.422335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.440245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 328/648] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:15.441276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.458495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.520424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d304a-f84c-4a31-801d-6a40c1d51858 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.550034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b968edb-ebb7-4aa1-84bb-79124b9f5d03 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.556346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.556956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.557242 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.557526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.558596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:15.558908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.560692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.577559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 321/649] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:15.577559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.578802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.593120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.593943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.594330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.594710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] PATH_INFO: `/v3/users/glance` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.602946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.604609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:15.617031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:15.618156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 22 05:32:15.619348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:15.620412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 329/650] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:15.621245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.693573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799c712-383b-48c7-8ed5-08cb336a2508 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.700416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.726222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa155191-b80b-4775-bd54-2f2299c101dd None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.729328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.729965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.730252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.730532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.741654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.743106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:15.758654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:15.759638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:15.760638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:15.760638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:15.760638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:15.760638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 322/651] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:15.760638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.767427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.768121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.768439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.768711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.817391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.843833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.845349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.869349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1643ff-ecef-4dab-9637-5ec2d6d4de29 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:15.905196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:15.905822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:15.906100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:15.906380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:15.913321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:15.915043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:15.920293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:15.927516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:15.934290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 323/652] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:15.935416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:15.958920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 330/653] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:15.958920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.046541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ae9d6-95a7-4574-918c-024690ad2193 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.056814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751ec1e-69d4-4e6f-9f21-23b96446116f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.062308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.079434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.079953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.080265 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.080545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.081276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:16.081585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.083068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.089896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.090493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.090782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.091167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.091713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:16.092035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.093445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.101162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 324/654] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:16.101954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.105059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 331/655] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:16.105859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.142570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.198996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e0d17-0bb8-4844-85ab-62228e23f21c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.206794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e920085-6315-4280-8f71-b7253d81c4a4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.233671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ec36a-9223-4292-b190-21edf5bc788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.234273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec36a-9223-4292-b190-21edf5bc788d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.234558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec36a-9223-4292-b190-21edf5bc788d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.234836 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ec36a-9223-4292-b190-21edf5bc788d None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.235649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ec36a-9223-4292-b190-21edf5bc788d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:16.235898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ec36a-9223-4292-b190-21edf5bc788d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.237344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ec36a-9223-4292-b190-21edf5bc788d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.244239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.244870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.245155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.245438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.249168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 325/656] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:16.250320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67cc9d-80ab-4ce7-9b7b-9b3ee36f783e None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.250612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67cc9d-80ab-4ce7-9b7b-9b3ee36f783e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.250896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67cc9d-80ab-4ce7-9b7b-9b3ee36f783e None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.252087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 326/657] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:16.252856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67cc9d-80ab-4ce7-9b7b-9b3ee36f783e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.256913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.258391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:16.272374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:16.273482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:16.274656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:16.274656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:16.274656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:16.274656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 332/658] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:16.274656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.294480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.357571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.360149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67cc9d-80ab-4ce7-9b7b-9b3ee36f783e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.372309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867a8ab-979e-4858-8ee2-b4d5b6cbe773 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.393062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfbc97c-2d71-483d-aba7-2a3895b2ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.393660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbc97c-2d71-483d-aba7-2a3895b2ce06 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.393942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbc97c-2d71-483d-aba7-2a3895b2ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.394216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfbc97c-2d71-483d-aba7-2a3895b2ce06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.405546 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.406171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.406456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.406736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.414092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.415531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:16.427066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:16.428250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 333/659] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:16.429419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.463699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbc97c-2d71-483d-aba7-2a3895b2ce06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.465268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfbc97c-2d71-483d-aba7-2a3895b2ce06 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.496644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.524206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c2dc3-8bb4-4a7c-88cd-a6f8fbea3441 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.557014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.557624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.557866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.558140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.558855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=344aa2356f0c4d8fb88e7c35603a65c0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:16.559162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.560615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.561743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 327/660] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:16.563128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f048d-0385-4780-8814-af7b5f3dbf60 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.563847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f048d-0385-4780-8814-af7b5f3dbf60 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.564132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f048d-0385-4780-8814-af7b5f3dbf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.566673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 334/661] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/role_assignments?user.id=344aa2356f0c4d8fb88e7c35603a65c0&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:16.567388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.580671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.589414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e17f048d-0385-4780-8814-af7b5f3dbf60 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:16.590683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e17f048d-0385-4780-8814-af7b5f3dbf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:16.666903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 328/662] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:16.667775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f048d-0385-4780-8814-af7b5f3dbf60 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.691138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6509b4-c673-42b1-ba68-9c56955ceb22 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.739171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.739931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.740605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.740986 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.742515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:16.742626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.744216 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.749705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.761684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 335/663] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:16.762840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.800601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f048d-0385-4780-8814-af7b5f3dbf60 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.846856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.847675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.847967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.848291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.849637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:16.849637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.850792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.855193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:16.872872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 329/664] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:16.873894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.892384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889a1f-1f69-451d-ba67-2a6c29664793 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:16.931563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414610d-27ff-4120-9631-f502077f515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:16.932550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414610d-27ff-4120-9631-f502077f515d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:16.932999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414610d-27ff-4120-9631-f502077f515d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:16.933446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414610d-27ff-4120-9631-f502077f515d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:16.944817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414610d-27ff-4120-9631-f502077f515d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:16.946266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414610d-27ff-4120-9631-f502077f515d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-5414610d-27ff-4120-9631-f502077f515d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:16.961670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:16.962639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:16.963542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:16.963542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:16.963542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:16.963542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 336/665] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:16.964214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414610d-27ff-4120-9631-f502077f515d None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:16.996114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0f700-435a-486a-b1aa-86910a184540 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.020926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.032727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.033357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.034284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.034284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.041210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.042658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:17.054327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:17.055247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:17.056135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 330/666] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:17.057192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.070476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414610d-27ff-4120-9631-f502077f515d None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.092921 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.107271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.107875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.108379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.108602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.161365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b3169-ac87-42df-b65e-c7849d446661 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.177836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.179287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.198263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.198815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.199094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.199623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.210197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:17.215260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:17.216220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 331/667] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:17.217082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.262912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.287755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 337/668] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:17.290914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.316582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.328928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc277ce2-366e-410e-a54f-35434725e07a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.363926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.364570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.364859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.365137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.365781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:17.366090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.367459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.383311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 332/669] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:17.383311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.400092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a29bf0-0524-432a-a828-371beff2846c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.434930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.435527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.435814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.436087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.436802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:17.437109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.438544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.449831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 338/670] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:17.455258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.484808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81558e35-2932-4ef0-88df-a142113a98c6 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.486621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.517565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.518193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.518472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.518749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.519969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:17.520298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.521658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.529118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 333/671] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:17.529882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.548623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.567451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb695db6-c19e-4a59-98ca-3e22b7f3e0a1 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.609393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.610609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.611351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.611838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.623269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.624734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.633307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a0137f-9dde-45d2-9c64-8a0e52b1878a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:17.639689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:17.640831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:17.641736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:17.641736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:17.641736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:17.641736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 339/672] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:17.641736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.671747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.672398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.672684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.672960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.680372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.682608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:17.694146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:17.695136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 334/673] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:17.696031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.726435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.758084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f059a-24e8-4f25-b8dd-298133ea431b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.795129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.795753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.796036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.796373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.797337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=a1af7582d3e94be1815574887e988e2c) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:17.797484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.798930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.801767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:17.816223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 340/674] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/role_assignments?user.id=a1af7582d3e94be1815574887e988e2c&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:17.816437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea0d55-a913-4b60-82e2-f75390e1815e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.816520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.854399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.855118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.855399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.855792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.867331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.868958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:17.887517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:17.888716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:17.889676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:17.889676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:17.889676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:17.889676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 335/675] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:17.889917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:17.942651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fba9e-3772-448e-8b9c-84880a7926d7 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:17.987773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:17.988370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:17.988654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:17.988931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:17.989584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:17.990033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:17.991404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:17.993942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:18.004032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 341/676] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:18.005312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.019058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233f4a1-cfd7-4a86-a04b-6e4b427b9629 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.061707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.062324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.062606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.062880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.063619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:18.063930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.065639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.075279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:18.079559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 336/677] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:18.080417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.134963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a7dc-af65-45e5-9113-6c770b285eaf None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.183866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.184657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.185036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.185431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.186180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:18.186607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.188858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.199488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a935a8-b7d7-4db9-ad66-8c3a5e8e98a5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.210114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 342/678] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:18.210114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.247011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.247950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.248382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.248758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.252340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:18.258714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.260893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:18.277164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:18.278273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:18.279387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:18.286854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 337/679] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:18.286854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.343737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e787ac12-08d6-4859-af4f-f6215b38b54e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.362883 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:18.381685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.382650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.383061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.383496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.384456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=38d2e7ee450e44299a99cba466545701) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:18.384943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.386495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.393259 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 343/680] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/role_assignments?user.id=38d2e7ee450e44299a99cba466545701&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:18.400289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891fc31-305f-49ba-a2a9-8750f4982723 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.401102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.453644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.454427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.454567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.454836 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.474153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.475642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:18.494362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:18.495575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:18.496857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 338/681] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:18.509372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.531196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d9786-c9eb-4b43-aa5d-d6ce676baa41 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.571707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.573822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.575730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.576179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.577073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:18.578292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.579957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.616108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 344/682] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:18.618988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.638837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:18.681155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:18.694806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee062ab2-015a-4a41-9044-7c4450dabc61 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.743432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562258f-680a-4796-b00b-5de48d2d7fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.744387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562258f-680a-4796-b00b-5de48d2d7fd2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.744818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562258f-680a-4796-b00b-5de48d2d7fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.745241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562258f-680a-4796-b00b-5de48d2d7fd2 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.746124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562258f-680a-4796-b00b-5de48d2d7fd2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:18.746608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562258f-680a-4796-b00b-5de48d2d7fd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.748169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562258f-680a-4796-b00b-5de48d2d7fd2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.750393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7841240-2740-4e7c-beef-8d63e2d4323f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.776359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 339/683] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:18.776359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26911dce-95c2-4d53-9dbf-d8b6a71fadb3 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.776359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26911dce-95c2-4d53-9dbf-d8b6a71fadb3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.776359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26911dce-95c2-4d53-9dbf-d8b6a71fadb3 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.776359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 340/684] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:18.776359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26911dce-95c2-4d53-9dbf-d8b6a71fadb3 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:18.798302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33339852-114b-4190-90f9-c703eadf3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.799093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339852-114b-4190-90f9-c703eadf3dff None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.799479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339852-114b-4190-90f9-c703eadf3dff None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.799857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33339852-114b-4190-90f9-c703eadf3dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.800762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33339852-114b-4190-90f9-c703eadf3dff None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=2d46d5905b004073b10e694ab79e7187) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:18.801286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33339852-114b-4190-90f9-c703eadf3dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:18.802845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33339852-114b-4190-90f9-c703eadf3dff None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:18.814950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 345/685] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/role_assignments?user.id=2d46d5905b004073b10e694ab79e7187&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:18.816525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b2e1-99cb-4820-a7b2-0c66fe002fb1 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.816950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b2e1-99cb-4820-a7b2-0c66fe002fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.817382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6b2e1-99cb-4820-a7b2-0c66fe002fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.857510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-cab6b2e1-99cb-4820-a7b2-0c66fe002fb1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:18.858820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-cab6b2e1-99cb-4820-a7b2-0c66fe002fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:18.895776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26911dce-95c2-4d53-9dbf-d8b6a71fadb3 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:18.912772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:18.934893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:18.935523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:18.935806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:18.936085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:18.999412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 346/686] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:19.014269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:19.015740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:19.124416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 341/687] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:19.130657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6b2e1-99cb-4820-a7b2-0c66fe002fb1 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:19.166536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:19.244578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6b2e1-99cb-4820-a7b2-0c66fe002fb1 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:19.288967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:19.289628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:19.289912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:19.290192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:19.298770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:19.315921 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:19.316694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:19.317940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:19.344277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:19.345361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:19.346346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:19.346346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:19.346346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:19.355927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 347/688] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:19.356884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:19.455207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03db1de-9c16-4ff2-81e4-963dd509e368 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:19.531984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:19.536869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34320dc-98ce-4ec1-b7a5-f30914050828 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:19.540911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:19.541557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:19.541837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:19.542115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:19.565262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:19.573653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:19.574278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:19.574659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:19.574944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:19.575603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:19.575916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:19.577385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:19.578890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:19.579829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:19.580712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 342/689] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:19.588505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:19.590009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 348/690] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:19.603329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:19.694823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5c25b-8891-4f52-be53-eb8768e02fd4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:19.696781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:19.760269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:19.760792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:19.761074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:19.761347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:19.762022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:19.762330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:19.763697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:19.782824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 343/691] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:19.789810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:19.808526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5b0fb4-3187-483a-91f5-fb4e2e0e6811 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:19.884145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ca6ea-d0e8-4df9-9f82-fcbb83e96b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:19.884808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ca6ea-d0e8-4df9-9f82-fcbb83e96b8f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:19.885088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ca6ea-d0e8-4df9-9f82-fcbb83e96b8f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:19.885366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ca6ea-d0e8-4df9-9f82-fcbb83e96b8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:19.901285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ca6ea-d0e8-4df9-9f82-fcbb83e96b8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:19.902764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ca6ea-d0e8-4df9-9f82-fcbb83e96b8f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-923ca6ea-d0e8-4df9-9f82-fcbb83e96b8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:19.928775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:19.929762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:19.930755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 349/692] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:19.932242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e8d02-cba2-4817-8225-addb71a3ad80 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:19.936831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e8d02-cba2-4817-8225-addb71a3ad80 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:19.937140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e8d02-cba2-4817-8225-addb71a3ad80 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:19.939272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 350/693] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:19.939986 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e8d02-cba2-4817-8225-addb71a3ad80 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:19.956164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:19.961637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148f621-0ba5-4747-b8d2-4698ff50ec32 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:19.999465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa0b78-525c-47cd-8cd6-3c8e8225223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.000092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa0b78-525c-47cd-8cd6-3c8e8225223f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.000401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa0b78-525c-47cd-8cd6-3c8e8225223f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.001026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa0b78-525c-47cd-8cd6-3c8e8225223f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.005921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:20.017844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa0b78-525c-47cd-8cd6-3c8e8225223f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.018424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa0b78-525c-47cd-8cd6-3c8e8225223f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-14fa0b78-525c-47cd-8cd6-3c8e8225223f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:20.038189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:20.039351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:20.040510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:20.040510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:20.040510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:20.044337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 344/694] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:20.045755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5402-639b-4ca2-bb73-8784dd9b635a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.046191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5402-639b-4ca2-bb73-8784dd9b635a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.046694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a5402-639b-4ca2-bb73-8784dd9b635a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.065925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4a5a5402-639b-4ca2-bb73-8784dd9b635a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:20.067360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4a5a5402-639b-4ca2-bb73-8784dd9b635a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:20.075629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e8d02-cba2-4817-8225-addb71a3ad80 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.110961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.111786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.112167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.112561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.114147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:20.114555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.116166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.134554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 351/695] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:20.135545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:20.144292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 345/696] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:20.145430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5402-639b-4ca2-bb73-8784dd9b635a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:20.231394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:20.300873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcb16c-b26e-4bee-a351-f3de0dc07c18 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.325956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a5402-639b-4ca2-bb73-8784dd9b635a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.362644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:20.369261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.369879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.370166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.370445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.371103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:20.371420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.372818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.397507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.398149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.398435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.401087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.401885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=9800dbdc23794d9eb02e3c2002b096b2) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:20.402209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.403696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.404997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 352/697] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:20.405975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:20.422097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 346/698] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/role_assignments?user.id=9800dbdc23794d9eb02e3c2002b096b2&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:20.478276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:20.526256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e2498-16a8-4f53-8f31-9710c088b7e4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.561647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:20.565070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.565815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.566628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.566910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.575362 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.576866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:20.591017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:20.592054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:20.593465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 353/699] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:20.595308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc44da8-c54f-461a-bfd4-f107f58fa6b6 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.602119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:20.631974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.632646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.632931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.633213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.633823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.635219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:20.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:20.654240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:20.655100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:20.660309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 347/700] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:20.663322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:20.741879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:20.770020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca500b-c161-4d6b-b326-29f16990d3cc None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.814878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7349c71-9ef4-4672-b0c2-dfbc25730e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.815571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7349c71-9ef4-4672-b0c2-dfbc25730e03 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.815863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7349c71-9ef4-4672-b0c2-dfbc25730e03 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.816701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7349c71-9ef4-4672-b0c2-dfbc25730e03 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.817452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7349c71-9ef4-4672-b0c2-dfbc25730e03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:20.817765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280f178-5e04-4a07-bffb-8228977368c2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.817868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7349c71-9ef4-4672-b0c2-dfbc25730e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.819228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7349c71-9ef4-4672-b0c2-dfbc25730e03 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.840754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 354/701] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:20.842026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae0bbe-097d-4d26-8df1-0c4ed37ebd28 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.842315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae0bbe-097d-4d26-8df1-0c4ed37ebd28 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.842593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae0bbe-097d-4d26-8df1-0c4ed37ebd28 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.844066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 355/702] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:20.849017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae0bbe-097d-4d26-8df1-0c4ed37ebd28 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:20.860685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc610cb-ef63-43a2-aa7d-d9c8c72a5d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:20.861437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc610cb-ef63-43a2-aa7d-d9c8c72a5d0d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.861792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc610cb-ef63-43a2-aa7d-d9c8c72a5d0d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.862148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc610cb-ef63-43a2-aa7d-d9c8c72a5d0d None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.862936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc610cb-ef63-43a2-aa7d-d9c8c72a5d0d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:20.863375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc610cb-ef63-43a2-aa7d-d9c8c72a5d0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:20.864880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc610cb-ef63-43a2-aa7d-d9c8c72a5d0d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:20.870583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 348/703] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:20.871588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68440d0-8230-4196-8027-12ab09d5f4c3 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:20.872005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68440d0-8230-4196-8027-12ab09d5f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:20.872325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68440d0-8230-4196-8027-12ab09d5f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:20.891779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c68440d0-8230-4196-8027-12ab09d5f4c3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:20.893077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c68440d0-8230-4196-8027-12ab09d5f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:20.903891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:20.969786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae0bbe-097d-4d26-8df1-0c4ed37ebd28 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:20.978403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 349/704] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:20.979277 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68440d0-8230-4196-8027-12ab09d5f4c3 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:21.032933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:21.073931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:21.074474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.074757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.075030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.100638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68440d0-8230-4196-8027-12ab09d5f4c3 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:21.142601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:21.143218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.143506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.143786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.144491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:21.144805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:21.146837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:21.153156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 350/705] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:21.207946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:21.209877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:21.262758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:21.312357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:21.328313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 356/706] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:21.332696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:21.466176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b838d-0e97-4358-8268-09dcad147192 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:21.468887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace9d21e-37a6-4311-9ee5-6a86cba37ef9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:21.469383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:21.508608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385b2ad-8a3d-4773-bc06-0fec7b14608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:21.509252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b2ad-8a3d-4773-bc06-0fec7b14608d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.509542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b2ad-8a3d-4773-bc06-0fec7b14608d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.509821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385b2ad-8a3d-4773-bc06-0fec7b14608d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.511309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:21.512388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.513209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.513642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.521117 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385b2ad-8a3d-4773-bc06-0fec7b14608d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:21.522599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385b2ad-8a3d-4773-bc06-0fec7b14608d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:21.526388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:21.527988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:21.536730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-8385b2ad-8a3d-4773-bc06-0fec7b14608d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:21.537606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:21.538749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:21.539720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:21.539720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:21.539720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:21.539720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 351/707] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:21.540334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f8f3-5523-4b23-a76e-8351897ffb5b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.540682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f8f3-5523-4b23-a76e-8351897ffb5b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.540969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97f8f3-5523-4b23-a76e-8351897ffb5b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.542433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 352/708] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:21.548571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:21.551819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:21.552743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:21.552743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:21.552743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:21.552743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 357/709] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:21.552974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3080fc-b52d-47ef-ad39-3436e07e4f0a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.552974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3080fc-b52d-47ef-ad39-3436e07e4f0a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.553284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3080fc-b52d-47ef-ad39-3436e07e4f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.554112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:21.579427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-be3080fc-b52d-47ef-ad39-3436e07e4f0a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:21.581010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-be3080fc-b52d-47ef-ad39-3436e07e4f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:21.668229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 353/710] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:21.668229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3080fc-b52d-47ef-ad39-3436e07e4f0a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:21.722235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d75eca-4c78-4624-9557-a58ce3d8b042 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:21.764554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:21.780447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3080fc-b52d-47ef-ad39-3436e07e4f0a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:21.801594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:21.802214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.802497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.802771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.803431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:21.803743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:21.805148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:21.817818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 358/711] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:21.823357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:21.854006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:21.854643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:21.854941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:21.855226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:21.855890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:21.856226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:21.857625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:21.887432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:21.891358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 354/712] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:21.897484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:21.962811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da4ca8-67fb-45a7-a2a4-000400ad3841 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:22.006378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:22.007074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.007272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.007558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.008220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:22.009685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:22.044567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948dff-039b-42f0-841a-823e56e47920 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:22.078593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:22.079221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.079506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.079785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.087406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:22.088871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:22.099926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:22.100976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:22.102353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:22.104386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 355/713] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:22.105536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:22.116403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:22.129353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 359/714] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:32:21 2022] POST /identity/v3/users => generated 254 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:22.130707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:22.215373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1422c4-46bb-46e2-ad5f-d523a28b9855 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:22.251339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:22.251974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.252282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.252562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] PATH_INFO: `/v3/services/network` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.260230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:22.260230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:22.266122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:22.271365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:22.272263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 356/715] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:22 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:22.281275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:22.310088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4dff18-5117-4d7a-a9eb-5de7d237b685 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:22.328416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:22.352942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:22.353946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.354533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.355192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.356126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:22.356706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:22.358394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:22.373049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 360/716] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:22.379699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:22.427114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:22.465198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcfce2-b622-4d90-b220-baa40f4c4c39 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:22.486687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a53bb-12b0-40cb-b3d3-4b2ed6e769e9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:22.502667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:22.503205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.504030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.504300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.504944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] RBAC: Adding query filter params (name=network) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:22.505253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:22.506631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:22.511835 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 357/717] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:22.518164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:22.535625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e6ba3-681f-4c51-a54a-723acede2b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:22.536583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e6ba3-681f-4c51-a54a-723acede2b30 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.537109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e6ba3-681f-4c51-a54a-723acede2b30 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.537487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e6ba3-681f-4c51-a54a-723acede2b30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.538319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e6ba3-681f-4c51-a54a-723acede2b30 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=344aa2356f0c4d8fb88e7c35603a65c0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:22.538729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e6ba3-681f-4c51-a54a-723acede2b30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:22.540852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e6ba3-681f-4c51-a54a-723acede2b30 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:22.551089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 361/718] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:22 2022] GET /identity/v3/role_assignments?user.id=344aa2356f0c4d8fb88e7c35603a65c0&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:22.651662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca2ac-9dd6-4646-af4f-92c935011932 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:22.690438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4361c-a72f-4cf6-8fd0-28451c48ac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:22.691878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4361c-a72f-4cf6-8fd0-28451c48ac29 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.692359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4361c-a72f-4cf6-8fd0-28451c48ac29 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.692845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4361c-a72f-4cf6-8fd0-28451c48ac29 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.693637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4361c-a72f-4cf6-8fd0-28451c48ac29 None admin] RBAC: Adding query filter params (type=network) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:22.694091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4361c-a72f-4cf6-8fd0-28451c48ac29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:22.695661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4361c-a72f-4cf6-8fd0-28451c48ac29 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:22.697368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:22.702122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 358/719] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:22.879427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e043-c844-4835-b0ff-7db8cc409d9e None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.879953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e043-c844-4835-b0ff-7db8cc409d9e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.879953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d8e043-c844-4835-b0ff-7db8cc409d9e None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.881593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 362/720] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:22.887678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfd8f1-fa47-41fb-a064-bccd1126c795 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:22.887968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfd8f1-fa47-41fb-a064-bccd1126c795 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:22.888283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfd8f1-fa47-41fb-a064-bccd1126c795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:22.908260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b2bfd8f1-fa47-41fb-a064-bccd1126c795 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:22.909415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b2bfd8f1-fa47-41fb-a064-bccd1126c795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:22.981267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 359/721] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:23.336651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a3b92-4e35-419b-a02e-94db74238c6d None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:23.336978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a3b92-4e35-419b-a02e-94db74238c6d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:23.337213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a3b92-4e35-419b-a02e-94db74238c6d None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:23.338545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 363/722] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:23.345533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924e3b-8c05-40e3-b014-ef3010af9eea None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:23.345826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924e3b-8c05-40e3-b014-ef3010af9eea None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:23.346110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924e3b-8c05-40e3-b014-ef3010af9eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:23.372363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c4924e3b-8c05-40e3-b014-ef3010af9eea None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:23.373569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c4924e3b-8c05-40e3-b014-ef3010af9eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:23.388390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a3b92-4e35-419b-a02e-94db74238c6d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:23.466274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:23.489058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 360/723] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:23.556725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a3b92-4e35-419b-a02e-94db74238c6d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:23.601281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:23.601910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:23.602192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:23.602466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:23.619759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:23.624940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:23.625865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:23.627021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 364/724] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:23.632319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924e3b-8c05-40e3-b014-ef3010af9eea None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:23.725211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:23.780103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924e3b-8c05-40e3-b014-ef3010af9eea None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:23.829604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:23.830153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:23.830435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:23.830712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:23.832038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:23.832386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:23.833793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:23.848114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 361/725] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:23.853287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:23.965890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:23.981662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c8906-ea06-4c12-a599-bc66a6e3a966 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:23.991673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:24.018446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:24.019144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:24.019469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:24.019743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:24.030735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:24.032212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:24.046558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:24.047604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:24.049104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:24.049104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:24.049104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:24.049104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 365/726] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:24.055060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:24.195092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c9dd0-faf4-4254-9bd6-a3401bfd1bc7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:24.231383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:24.240958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bd365-562f-47ea-a408-72116d9bae35 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:24.262589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:24.263200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:24.263485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:24.263758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:24.264433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:24.265817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:24.307518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:24.308129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:24.308438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:24.308714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:24.309421 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:24.309728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:24.311162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:24.323723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 366/727] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:24.328996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:24.364588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:24.406389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 362/728] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:23 2022] POST /identity/v3/services => generated 251 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:32:24.492320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b20eba-1d2c-46d9-83de-f8403fda32e8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:24.542370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb830e-ecac-4542-a560-11b74bc6d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:24.543370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb830e-ecac-4542-a560-11b74bc6d29f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:24.543878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb830e-ecac-4542-a560-11b74bc6d29f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:24.544414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb830e-ecac-4542-a560-11b74bc6d29f None admin] PATH_INFO: `/v3/users/swift` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:24.562216 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb830e-ecac-4542-a560-11b74bc6d29f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:24.564035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb830e-ecac-4542-a560-11b74bc6d29f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-efdb830e-ecac-4542-a560-11b74bc6d29f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:24.584614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:24.585636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:24.586577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:24.589283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 367/729] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:24.595205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:24.764048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2933-3d28-46a0-a222-e92116700337 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:24.818215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:24.818856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:24.819140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:24.819415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:24.820162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:24.825113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:24.826601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:24.833697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d986-bd63-406c-94a0-a4b2738429be None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:24.834246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d986-bd63-406c-94a0-a4b2738429be None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:24.834977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690d986-bd63-406c-94a0-a4b2738429be None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:24.840297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 368/730] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:24.845445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c6dd-43b3-440b-9f0f-20eb627fc722 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:24.845804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c6dd-43b3-440b-9f0f-20eb627fc722 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:24.846184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36c6dd-43b3-440b-9f0f-20eb627fc722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:24.861407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 363/731] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Aug 22 05:32:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:24.870213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:24.898618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fa36c6dd-43b3-440b-9f0f-20eb627fc722 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:24.900137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fa36c6dd-43b3-440b-9f0f-20eb627fc722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:24.973792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:25.043020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:25.068229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 369/732] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:25.071458 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192271-3872-4bef-ba26-3e72bc3a9c52 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.071819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192271-3872-4bef-ba26-3e72bc3a9c52 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.072170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b192271-3872-4bef-ba26-3e72bc3a9c52 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.074213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 370/733] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:25.081942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676e69-480b-4e82-ac3b-6ed312016c11 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.088486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676e69-480b-4e82-ac3b-6ed312016c11 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.088836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676e69-480b-4e82-ac3b-6ed312016c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.129275 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ac676e69-480b-4e82-ac3b-6ed312016c11 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:25.130506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ac676e69-480b-4e82-ac3b-6ed312016c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:25.148501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617e40-8a4b-4489-b235-240a8ca9fb7b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:25.203033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:25.203647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.203934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.204253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.244852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 371/734] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:25.246554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007e57-5e80-49e7-a702-026d9c156ae2 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.247043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007e57-5e80-49e7-a702-026d9c156ae2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.247530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21007e57-5e80-49e7-a702-026d9c156ae2 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.249363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 372/735] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:25.258692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed910c-c1c5-4faa-9dee-2b1762ab852e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.259665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed910c-c1c5-4faa-9dee-2b1762ab852e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.260148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed910c-c1c5-4faa-9dee-2b1762ab852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.281503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-58ed910c-c1c5-4faa-9dee-2b1762ab852e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:25.283460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-58ed910c-c1c5-4faa-9dee-2b1762ab852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:25.337391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:25.338795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:25.363576 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 373/736] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 22 05:32:25.381300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed910c-c1c5-4faa-9dee-2b1762ab852e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:25.404659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:25.485404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:25.505641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 364/737] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 22 05:32:25.511264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:25.578809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed910c-c1c5-4faa-9dee-2b1762ab852e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:25.632712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dca951-2d40-4e8c-89be-43bb8b26eb26 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:25.635705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:25.637176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.637518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.637802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.650439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:25.656506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:25.657454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 374/738] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:25.658928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:25.677142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:25.677847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.678133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.678417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.685174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:25.689131 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:25.690599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:25.705500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:25.707157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:25.708182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:25.708182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:25.708182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:25.708182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 365/739] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:25.708470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:25.783133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed654e8-19f9-4e2a-a583-5d0ea9e99845 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:25.803319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:25.814029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704de35-3d61-43e1-b2e4-485a7e2d8f72 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:25.821959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:25.822439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.822723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.823000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.834013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:25.838924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:25.839834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 375/740] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:25.841386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:25.855456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:25.856158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:25.856486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:25.856766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:25.857441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:25.857744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:25.859157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:25.867234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 366/741] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:25.867995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:25.919947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:25.966289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639b42c-fe0f-471b-8103-3264e6dbb8be None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:25.966532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f0ee-8c5b-48bf-be15-b6729127e1f8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.000002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.000643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.000927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.001211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.001847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.002322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.002934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.003726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.003825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.004009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.004692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:26.005006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.006382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.018692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 367/742] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:26.022582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.094271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 376/743] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:25 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:26.095804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.140184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:26.140572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e15245-7e18-4323-82c4-8a1297f895a7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.161582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:26.194014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.194560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.194842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.195129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.195799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:26.196108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.201294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.216849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 368/744] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:26.218090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.240091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d721b-5a10-4d50-8175-4aab264bf5f9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.282357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.283005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.283303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.283566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.301970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.303775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:26.321529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:26.322620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:26.331102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:26.331102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:26.331102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:26.331102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 377/745] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:26.331102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.366125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63a620-e653-4eb3-9f50-9a82e3b7e1f0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.409997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.410655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.410940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.411218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.418331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.419817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.425340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:26.431482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:26.432436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 369/746] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:26.433832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.438346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f35ccc-fd41-435b-b65f-ec569b9610ab None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.470506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:26.482491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.483138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.485016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.485016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.496869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.498885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:26.521147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:26.522442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:26.523378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:26.523378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:26.523378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:26.527389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 378/747] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:26.528268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.554613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c5591-1e24-4406-801a-feb918ba7938 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.602959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.603673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.604444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.604805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.605809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:26.606188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.607639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.624341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 370/748] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:26.625480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.653392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e022da-de48-4070-ab74-4bb42254755e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.689750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.691110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.691394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.691673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.692398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:26.692709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.694135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.702939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:26.711789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 379/749] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:26.711789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.730308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:26.740377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c64c30-87e8-4383-8fcc-242f944970e8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.777489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150504ee-0355-4953-ba49-be244bff9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.778100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150504ee-0355-4953-ba49-be244bff9f00 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.778384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150504ee-0355-4953-ba49-be244bff9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.778665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150504ee-0355-4953-ba49-be244bff9f00 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.779317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150504ee-0355-4953-ba49-be244bff9f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:26.779631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150504ee-0355-4953-ba49-be244bff9f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.781057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150504ee-0355-4953-ba49-be244bff9f00 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.793574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 371/750] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:26.794798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709057b4-00ae-429e-a449-5006d2812011 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.795083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709057b4-00ae-429e-a449-5006d2812011 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.795358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709057b4-00ae-429e-a449-5006d2812011 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.800247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 372/751] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:26.800247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709057b4-00ae-429e-a449-5006d2812011 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.820827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3fe7f-6b6b-46b6-8807-12e5dd17aa6b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.860454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.861113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.861397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.861676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.868740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.870290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:26.882444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:26.883566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 380/752] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:26.885026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:26.911584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709057b4-00ae-429e-a449-5006d2812011 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:26.946008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:26.949966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9e1c4-7438-40ed-bef2-b0265ccc13e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:26.950683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9e1c4-7438-40ed-bef2-b0265ccc13e6 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.950971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9e1c4-7438-40ed-bef2-b0265ccc13e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.951247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9e1c4-7438-40ed-bef2-b0265ccc13e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.951976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9e1c4-7438-40ed-bef2-b0265ccc13e6 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=9800dbdc23794d9eb02e3c2002b096b2) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:26.952329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9e1c4-7438-40ed-bef2-b0265ccc13e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:26.953856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b9e1c4-7438-40ed-bef2-b0265ccc13e6 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:26.960524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 373/753] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/role_assignments?user.id=9800dbdc23794d9eb02e3c2002b096b2&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:26.961732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c3887-9d7b-4ac4-8b8c-b443a64bd70d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:26.962022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c3887-9d7b-4ac4-8b8c-b443a64bd70d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:26.962305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c3887-9d7b-4ac4-8b8c-b443a64bd70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:26.981926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-cf3c3887-9d7b-4ac4-8b8c-b443a64bd70d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:26.983957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-cf3c3887-9d7b-4ac4-8b8c-b443a64bd70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:26.996236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:27.012371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04795236-d32d-46e7-9262-5836492c4c84 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.057772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.058687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.059089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.059440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.069670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.071401 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.072929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 374/754] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:27.074104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c3887-9d7b-4ac4-8b8c-b443a64bd70d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:27.097861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:27.099242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:27.103556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:27.107447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 381/755] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:32:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:27.115100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.248580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c3887-9d7b-4ac4-8b8c-b443a64bd70d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.296967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.297553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.297843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.298122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.298964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:27.299275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.300809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.302182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb8f19-c639-415e-bddc-e41845d5fc46 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.323026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:27.337619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 375/756] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:27.338351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.343414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.344021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.344553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.344751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.345980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:27.346500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.348207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.348833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:27.367195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 382/757] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:27.372883 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.479184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fab37-efcf-462e-9bb7-da4ae6d2a74a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.480678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022363c0-c088-4315-8f6d-f9a5e9cc0181 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.522254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.522814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.523092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.523365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.528106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.529021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.529511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.530213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.533931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.536222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:27.552499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:27.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:27.554770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:27.554770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:27.554770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:27.556555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 383/758] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:27.557482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.599875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:27.617584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.619911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.622294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:27.688540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417f185-2b2d-49d6-8c4e-4b5aaf02f52b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.724722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 376/759] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 05:32:27.725786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.732625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.733376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.733769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.734148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.734993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.736441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:27.748122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:27.749395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:27.750425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:27.752495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 384/760] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:27.753461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.830517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830135-a484-4572-8db0-4b5fa4a6cbca None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.832849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:27.857792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:27.865381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093ce9-b0a7-411c-a039-f31142c61901 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:27.867708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.868528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.868972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.869503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.870292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:27.870740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.872269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.884859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 377/761] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:27.885845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:27.909991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:27.910658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:27.910948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:27.911484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:27.924718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:27.926926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:27.945215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:27.946339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:27.947465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:27.947465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:27.947465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:27.948800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 385/762] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:27.949706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.032493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae30b4-4374-4ea4-b3a7-a4a4fbe9ff69 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.071674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e482e5-12e3-43d7-a4f1-f4696470629c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.078590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.079313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.080089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.080404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.081137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:28.081926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.083966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.092662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 378/763] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:28.093926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.110614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.111243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.111522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.111787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.118673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.120114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.125274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:28.131985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:28.138354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 386/764] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:28.139265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.142851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:28.211832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff2818f-56c9-4c55-99f9-dc93d41145d3 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.238023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c0f2f-a651-4676-ba67-cefa50a4db68 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.246685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32668f44-4182-4b79-9722-14eabdebb312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.247294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668f44-4182-4b79-9722-14eabdebb312 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.247573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668f44-4182-4b79-9722-14eabdebb312 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.247847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32668f44-4182-4b79-9722-14eabdebb312 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.248519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32668f44-4182-4b79-9722-14eabdebb312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:28.248826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32668f44-4182-4b79-9722-14eabdebb312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.250179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32668f44-4182-4b79-9722-14eabdebb312 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.266275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 379/765] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:28.266275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f1bb9-45d7-492c-bcfc-fd77e8279b6d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.266275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f1bb9-45d7-492c-bcfc-fd77e8279b6d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.266275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f1bb9-45d7-492c-bcfc-fd77e8279b6d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.266275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 380/766] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:28.266275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f1bb9-45d7-492c-bcfc-fd77e8279b6d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.280725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.281367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.281836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.282123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.282757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:28.283064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.286723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.299353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 387/767] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:28.299353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.366138 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:28.371535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:28.381814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f1bb9-45d7-492c-bcfc-fd77e8279b6d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.404594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf08199-c3fb-4586-a090-bdb6dcfaf221 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.416768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b50417-4b37-41ea-8e37-377c2503cd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.417452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50417-4b37-41ea-8e37-377c2503cd60 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.417811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50417-4b37-41ea-8e37-377c2503cd60 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.418152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b50417-4b37-41ea-8e37-377c2503cd60 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.418920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b50417-4b37-41ea-8e37-377c2503cd60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:28.419298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b50417-4b37-41ea-8e37-377c2503cd60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.420841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b50417-4b37-41ea-8e37-377c2503cd60 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.437701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 381/768] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:28.437701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4c0b-7c52-4a65-8d1a-8f9da12059ac None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.437701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4c0b-7c52-4a65-8d1a-8f9da12059ac None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.437701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea4c0b-7c52-4a65-8d1a-8f9da12059ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.445925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.446659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.447013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.447353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.453924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-50ea4c0b-7c52-4a65-8d1a-8f9da12059ac None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:28.454775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.455274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-50ea4c0b-7c52-4a65-8d1a-8f9da12059ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:28.456369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:28.468033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:28.469144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 388/769] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:28.474864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.530320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 382/770] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:28.530932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea4c0b-7c52-4a65-8d1a-8f9da12059ac None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.606714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e8053-a9ad-4344-bc48-fdd8fe8f61c5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.624588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:28.645533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:28.652928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea4c0b-7c52-4a65-8d1a-8f9da12059ac None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.653278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.654082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.654709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.655185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.656891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] RBAC: Adding query filter params (interface=public, service_id=365c3f0d94da48d795342ec9ed4d5d26, region_id=RegionOne) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:28.657399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.658961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.675386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 389/771] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/endpoints?service_id=365c3f0d94da48d795342ec9ed4d5d26&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:28.675386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.704097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.705133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.705594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.706626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/344aa2356f0c4d8fb88e7c35603a65c0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.708896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=344aa2356f0c4d8fb88e7c35603a65c0, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.710843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.779922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4dcc3-239c-4a9b-8ee5-d0a8f862c8f1 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.792813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 383/772] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:28 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/344aa2356f0c4d8fb88e7c35603a65c0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:28.792813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.831915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.832582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.832867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.833425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.834192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:28.834773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.836470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.851694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 390/773] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:28.852798 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.927350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da493c-f648-45c6-aeae-9a11e5d77d0d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:28.971546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:28.972445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:28.972855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:28.973235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:28.973969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:28.975491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:28.983024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 384/774] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:28.984111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:28.984975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:29.044564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:29.101250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61561d68-5813-47b5-b471-0d5f0bae1cd5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:29.124063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6e7f9-2e00-4a60-a9bb-472f039de4e4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:29.154989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da694b-7363-4c37-b97b-3cae38ca4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:29.155782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da694b-7363-4c37-b97b-3cae38ca4630 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.156068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da694b-7363-4c37-b97b-3cae38ca4630 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.156431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da694b-7363-4c37-b97b-3cae38ca4630 None admin] PATH_INFO: `/v3/services/network` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.157477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da694b-7363-4c37-b97b-3cae38ca4630 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:29.159175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da694b-7363-4c37-b97b-3cae38ca4630 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-36da694b-7363-4c37-b97b-3cae38ca4630 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:29.169552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:29.170793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:29.172010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 391/775] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/services/network => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:29.173201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c9a06-e78d-4505-aea2-50c2bf46af20 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.173302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c9a06-e78d-4505-aea2-50c2bf46af20 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.173896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c9a06-e78d-4505-aea2-50c2bf46af20 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.175456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 392/776] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:29.176863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c9a06-e78d-4505-aea2-50c2bf46af20 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:29.179642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdbdc2-10e8-4f50-91e1-954726b1b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:29.179642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdbdc2-10e8-4f50-91e1-954726b1b977 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.179642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdbdc2-10e8-4f50-91e1-954726b1b977 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.179642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdbdc2-10e8-4f50-91e1-954726b1b977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.180023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdbdc2-10e8-4f50-91e1-954726b1b977 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=2023824207074cc89a027c15b8425474) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:29.180023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdbdc2-10e8-4f50-91e1-954726b1b977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:29.182133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdbdc2-10e8-4f50-91e1-954726b1b977 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:29.192227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 385/777] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:28 2022] GET /identity/v3/role_assignments?user.id=2023824207074cc89a027c15b8425474&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:29.193833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55ac3-6967-4bc0-aa45-0a98c676ff4a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.194336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55ac3-6967-4bc0-aa45-0a98c676ff4a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.194833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e55ac3-6967-4bc0-aa45-0a98c676ff4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.235763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-69e55ac3-6967-4bc0-aa45-0a98c676ff4a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:29.238648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-69e55ac3-6967-4bc0-aa45-0a98c676ff4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:29.345271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c9a06-e78d-4505-aea2-50c2bf46af20 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:29.380679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:29.392699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:29.404620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:29.405238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.405564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.408032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.409207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] RBAC: Adding query filter params (name=network) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:29.410027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:29.411415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:29.414748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 386/778] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:29.418991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 393/779] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:29.424287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e55ac3-6967-4bc0-aa45-0a98c676ff4a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:29.546133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e55ac3-6967-4bc0-aa45-0a98c676ff4a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:29.588012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:29.588659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.588948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.589227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.589864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] RBAC: Adding query filter params (type=network) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:29.590177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:29.591557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:29.597108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 387/780] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:29.605959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:29.751219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:29.814269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc3ccc-7d61-4eb0-8022-3f4dd3f44127 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:29.820361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:29.867096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ef966-1305-4e02-8661-f5b7c4360937 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:29.904985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:29.905805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.906190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.906688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.917589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:29.922663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:29.923625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:29.924508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:29.928421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 388/781] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:29.930604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:29.948900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77844-6964-483e-936d-95933620009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:29.949530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77844-6964-483e-936d-95933620009e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:29.949815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77844-6964-483e-936d-95933620009e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:29.950092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff77844-6964-483e-936d-95933620009e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:29.950810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77844-6964-483e-936d-95933620009e None admin] RBAC: Adding query filter params (interface=public, service_id=81d9d640c4d34a0a89454fb4bbcdd6dd, region_id=RegionOne) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:29.951123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77844-6964-483e-936d-95933620009e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:29.952508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff77844-6964-483e-936d-95933620009e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:29.977832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 394/782] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:32:29 2022] GET /identity/v3/endpoints?service_id=81d9d640c4d34a0a89454fb4bbcdd6dd&interface=public®ion_id=RegionOne => generated 194 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:29.989165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77844-6964-483e-936d-95933620009e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:30.038331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200eb22-9626-4e9d-bedb-fe8446ca304b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:30.071287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:30.074750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:30.075368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:30.075656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:30.075937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:30.076663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:30.076975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:30.078744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:30.092911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 389/783] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:30.095289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:30.188598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:30.204973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498ea89-f89c-4f25-8fef-e26f8a91aab5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:30.244271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:30.244917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:30.245201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:30.245481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:30.256965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:30.258648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:30.274285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:30.276558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:30.277457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:30.277457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:30.277457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:30.280223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 390/784] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:30.281466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:30.315812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:30.349891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff77844-6964-483e-936d-95933620009e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:30.411533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d0613-2121-427b-b05f-a42367749f6d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:30.417714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:30.423702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:30.423999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:30.424305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:30.424959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:30.426413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:30.434919 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 395/785] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:32:29 2022] GET /identity/v3/services => generated 772 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:30.466523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:30.467216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:30.467560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:30.467888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:30.468584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:30.468897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:30.470301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:30.488404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 391/786] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:30.490945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:30.628431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1993fd-10ef-42a2-ae7f-52c25e923940 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:30.645103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:30.674242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:30.675448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:30.675736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:30.676020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] PATH_INFO: `/v3/users/swift` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:30.686923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:30.689174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:30.705838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:30.707369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:30.708368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 396/787] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:30.713707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:30.822880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:30.833072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71594b8d-4217-4d2f-973a-f67e10c469ed None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:30.875516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:30.876125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:30.876447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:30.876722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:30.877454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:30.877759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:30.879796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:30.898990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 392/788] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Aug 22 05:32:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:30.904395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.008704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cae0d8-f423-4ca2-beda-b3e7fe6affcd None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:31.043654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f1bca-4234-483e-bb91-8299752eb245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:31.044328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f1bca-4234-483e-bb91-8299752eb245 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.044611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f1bca-4234-483e-bb91-8299752eb245 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.044894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f1bca-4234-483e-bb91-8299752eb245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.055976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f1bca-4234-483e-bb91-8299752eb245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:31.057809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f1bca-4234-483e-bb91-8299752eb245 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-586f1bca-4234-483e-bb91-8299752eb245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:31.072800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:31.073874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:31.074761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:31.074761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:31.074761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:31.074761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 397/789] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:31.081865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.125791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f99c4-cb80-467f-86b3-3dfca0a32992 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.126099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f99c4-cb80-467f-86b3-3dfca0a32992 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.126349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f99c4-cb80-467f-86b3-3dfca0a32992 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.128460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 398/790] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:32:31.137496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23442a-a2a0-4643-b9f4-07b3b4b5f9ae None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.137739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23442a-a2a0-4643-b9f4-07b3b4b5f9ae None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.137997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23442a-a2a0-4643-b9f4-07b3b4b5f9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.157888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fe23442a-a2a0-4643-b9f4-07b3b4b5f9ae None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:31.159407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fe23442a-a2a0-4643-b9f4-07b3b4b5f9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:31.192694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:31.250334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1bf16-956c-43cb-b462-dcc1ccb226b1 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:31.263599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 399/791] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:31.265261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde41c4-29ef-417d-bb43-0b4a2172cc59 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.265728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde41c4-29ef-417d-bb43-0b4a2172cc59 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.266123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde41c4-29ef-417d-bb43-0b4a2172cc59 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.272351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 400/792] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:31.274061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c2a44-6b7f-4673-9f68-fac8187614f7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.274358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c2a44-6b7f-4673-9f68-fac8187614f7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.274633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c2a44-6b7f-4673-9f68-fac8187614f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.300510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-245c2a44-6b7f-4673-9f68-fac8187614f7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:31.306656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-245c2a44-6b7f-4673-9f68-fac8187614f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:31.322311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af46e-d221-4e14-9fa0-7580214f7222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:31.323066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af46e-d221-4e14-9fa0-7580214f7222 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.323451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af46e-d221-4e14-9fa0-7580214f7222 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.323828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af46e-d221-4e14-9fa0-7580214f7222 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.324614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af46e-d221-4e14-9fa0-7580214f7222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:31.324995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af46e-d221-4e14-9fa0-7580214f7222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:31.326438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af46e-d221-4e14-9fa0-7580214f7222 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:31.343495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 393/793] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:31.343495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bdf20-e6b1-4660-8a17-9213dd781734 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.343495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bdf20-e6b1-4660-8a17-9213dd781734 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.343495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bdf20-e6b1-4660-8a17-9213dd781734 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.346731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 394/794] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:31.347733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bdf20-e6b1-4660-8a17-9213dd781734 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.361517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:31.420680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 401/795] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:31.420680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba764-224f-4911-ae8c-6ff11569b15c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.420680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba764-224f-4911-ae8c-6ff11569b15c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.420680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba764-224f-4911-ae8c-6ff11569b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.453946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4caba764-224f-4911-ae8c-6ff11569b15c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:31.455143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4caba764-224f-4911-ae8c-6ff11569b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:31.493217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bdf20-e6b1-4660-8a17-9213dd781734 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:31.532919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:31.534701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.539547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.540052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.547560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:31.551713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:31.574233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:31.575161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:31.576115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:31.584463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 395/796] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:31.584463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.598163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 402/797] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:31.599778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caba764-224f-4911-ae8c-6ff11569b15c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.615189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:31.726252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caba764-224f-4911-ae8c-6ff11569b15c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:31.736393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:31.777134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:31.777611 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387db18-d3f4-4b8e-8999-9776efbcdfdd None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:31.778329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.778819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.779337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.780283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:31.780808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:31.782465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:31.800350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 403/798] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:31.801503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.814394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:31.815036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.815349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.815626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.826748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:31.832148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:31.833088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 396/799] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:31.834763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.880112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:31.913366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bbd25-d236-439f-bb61-b28daf6880c4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:31.946621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446d7a1-3c2d-4608-a0d6-312f2cd3b056 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:31.951205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:31.951875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.952162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.952489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.953085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:31.954466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:31.963512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:31.964527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:31.965371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 404/800] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Aug 22 05:32:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:31.966168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:31.981590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:31.987103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:31.988310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:31.988595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:31.988873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/9800dbdc23794d9eb02e3c2002b096b2/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:31.990762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=9800dbdc23794d9eb02e3c2002b096b2, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:31.992225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.072223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 397/801] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:31 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/9800dbdc23794d9eb02e3c2002b096b2/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:32.072223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.081807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e320de-b9ff-4b05-9df3-0853fe32b923 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.121650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.122356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.122640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.122918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.123675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:32.124035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.125629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.134166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:32.136719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 405/802] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:32.138132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.209973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20505bd8-4359-4828-9041-a65d2647f30c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.249192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.250096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.250521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.251378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.257019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa0578-ee79-4db8-bdf8-5f62c6ed8e73 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.264728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:32.270671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:32.271791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:32.272799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:32.274904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 398/803] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:32.275842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.297612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.298652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.299141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.299422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.300134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:32.300469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.304227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.308233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 406/804] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:32.308233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.352570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:32.381784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:32.394168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595db59-6922-4575-8ba7-4b65fcebbb94 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.422395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca4dcd-badd-466a-bb4d-07c8a5fd386a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.429565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.430436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.430885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.431628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.442852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.446174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:32.459926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:32.461121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:32.462014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:32.462014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:32.462014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:32.462192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.462192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.462192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.462192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.462453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:32.462453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.463723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.464743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 399/805] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:32.465873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.478303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 407/806] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:32.479335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.569765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9bca96-8ffa-4843-bcb2-d2e28b8185db None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.572921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:32.585386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42430a-3cbb-452f-9cb7-46b4dacff493 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.605811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.606794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.607316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.607854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.608716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:32.609263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.609923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:32.611051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.616667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 400/807] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:32.617889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.626558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.627221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.627559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.628381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.629209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:32.629339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.630689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.644618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 408/808] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:32.645540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.721292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3d4b2-04cb-4289-b9e9-849e7326bd8f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.749001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa768d7-202e-437c-b29d-9b1ae9a6bd7b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:32.756509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.757445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.757940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.758414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.769527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.771323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:32.786159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:32.787151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:32.788023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:32.788023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:32.788023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:32.788217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:32.788217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:32.788800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:32.788800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:32.789319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:32.790760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:32.791022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 401/809] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:32.792092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.813186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:32.915276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 409/810] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:32:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:32.922748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:32.983170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:33.020374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dd6d4-f5a3-4124-8f2e-437606d75428 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.057258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88565c-a2bb-46d5-a3da-5f4814e3ba9b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.070441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948320d2-3d27-4eec-b843-a524db3c328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.071728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948320d2-3d27-4eec-b843-a524db3c328f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.072169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948320d2-3d27-4eec-b843-a524db3c328f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.072614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948320d2-3d27-4eec-b843-a524db3c328f None admin] PATH_INFO: `/v3/users/nova` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.082414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948320d2-3d27-4eec-b843-a524db3c328f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.084094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948320d2-3d27-4eec-b843-a524db3c328f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-948320d2-3d27-4eec-b843-a524db3c328f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:33.096429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:33.097551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:32:33.098503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:33.099251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.100118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.100523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.100923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.101338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 402/811] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:33.102594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a658c-4906-4956-85f4-a7fd8ef2f26b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.102877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a658c-4906-4956-85f4-a7fd8ef2f26b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.103152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a658c-4906-4956-85f4-a7fd8ef2f26b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.104675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 403/812] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:33.109123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:33.109542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.110046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96bfad-b9e0-44aa-8c5a-9de0615044cf None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.110335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96bfad-b9e0-44aa-8c5a-9de0615044cf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.110614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96bfad-b9e0-44aa-8c5a-9de0615044cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.111289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.127148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 410/813] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:33.128602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:33.132603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fc96bfad-b9e0-44aa-8c5a-9de0615044cf None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:33.134754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fc96bfad-b9e0-44aa-8c5a-9de0615044cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:33.208373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 404/814] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:33.209440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96bfad-b9e0-44aa-8c5a-9de0615044cf None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:33.236652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:33.248429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:33.254732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49bc661-ffa7-46b9-ba3c-4a5630a4844e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.304965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.305608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.305857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.306129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.306870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:33.307172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.308638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.344423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 411/815] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:33.351565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:33.420245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96bfad-b9e0-44aa-8c5a-9de0615044cf None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.480325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.480891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.481175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.481450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.497219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.498686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.500410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0efa7b-d3b7-4494-aff7-1c6089e71137 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:33.521627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:33.522654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:33.523597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 405/816] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:33.524219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:33.543445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.544896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.545385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.545889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.577177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:33.622976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:33.637390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.639445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.661189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def480f-4630-4aa0-b811-ae65eccf3ca0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.697421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.698053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.698338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.698865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] PATH_INFO: `/v3/services/network` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.699182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.700571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:33.710113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:33.711143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:33.711978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 406/817] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:33.716616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:33.790519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 412/818] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:32:33.791128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:33.845001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c752de-3c35-4e68-88e4-ef4c7c8e7d86 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.852567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:33.879645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:33.885272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.886180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.886684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.887165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.888123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:33.888651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.890272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.899503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1b6f-5e6d-47d6-ac03-6d0cebaa757d None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:33.912963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 407/819] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:33.914153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:33.935502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:33.936099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:33.936447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:33.936722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:33.937353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] RBAC: Adding query filter params (name=network) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:33.937657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:33.939132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:33.950322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 413/820] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:33.951500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.025895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44957755-9476-4d7f-9caa-8c1c60f84f3c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.054872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47eadb-5a97-4e91-9f6a-9fa131236aaf None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.067716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.068923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.069839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.070678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.073021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:34.085435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.086877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.095461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.096436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.096936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.097409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:34.101541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:34.102474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:34.103356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:34.103356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:34.103356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:34.107247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 408/821] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:34.108091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.113079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.114537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:34.131049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:34.132073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:34.133015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:34.133015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:34.133015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:34.133809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 414/822] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:34.134351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.162808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:34.222215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873fd74-48ff-4954-987e-5f18b60d0c9b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.243388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7f36a-10e7-45a0-a59b-9e640512cc0a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.257418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280bf4-f88e-410c-b599-09d99e24dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.258107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280bf4-f88e-410c-b599-09d99e24dd5c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.258387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280bf4-f88e-410c-b599-09d99e24dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.258653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280bf4-f88e-410c-b599-09d99e24dd5c None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.259288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280bf4-f88e-410c-b599-09d99e24dd5c None admin] RBAC: Adding query filter params (type=network) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:34.259688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280bf4-f88e-410c-b599-09d99e24dd5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.261103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d280bf4-f88e-410c-b599-09d99e24dd5c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.271190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 409/823] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:34.271190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc71a-830b-45e9-b95a-29c62d950243 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.271190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc71a-830b-45e9-b95a-29c62d950243 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.271190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc71a-830b-45e9-b95a-29c62d950243 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.271190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 410/824] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:34.271190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc71a-830b-45e9-b95a-29c62d950243 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.292784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.293409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.293695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.293977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.294632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:34.294941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.296336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.309994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 415/825] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:34.310729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.346859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:34.382853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc71a-830b-45e9-b95a-29c62d950243 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.391049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:34.418086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b4103-9d41-461d-b6e6-4c93c3860036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.420578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816f3d1-dae1-4b7a-bb9e-94d08e1cd141 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.420880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4103-9d41-461d-b6e6-4c93c3860036 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.421863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4103-9d41-461d-b6e6-4c93c3860036 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.422595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b4103-9d41-461d-b6e6-4c93c3860036 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.424058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b4103-9d41-461d-b6e6-4c93c3860036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:34.424901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b4103-9d41-461d-b6e6-4c93c3860036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.426302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b4103-9d41-461d-b6e6-4c93c3860036 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.445323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 411/826] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:34.445323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956156-8ad0-4bb4-bccd-e94813701326 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.445323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956156-8ad0-4bb4-bccd-e94813701326 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.445323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b956156-8ad0-4bb4-bccd-e94813701326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.455069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.455707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.455990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.456290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.456950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.458309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.463226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4b956156-8ad0-4bb4-bccd-e94813701326 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:34.465107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4b956156-8ad0-4bb4-bccd-e94813701326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:34.532248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 412/827] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:34.533426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b956156-8ad0-4bb4-bccd-e94813701326 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.533534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 416/828] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:32:34 2022] POST /identity/v3/endpoints => generated 337 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:34.537163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.716480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:34.734481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:34.742855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b956156-8ad0-4bb4-bccd-e94813701326 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.750048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a72efe-4b0f-4df7-8acb-6fd41c200618 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.789839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.790842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.791471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.792056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.796245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.796903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.799348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.799348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.801456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.803051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.808979 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.810609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:34.819676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:34.820708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:34.821613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:34.823888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 413/829] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:34.826746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:34.827645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:34.828604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 417/830] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:34.832674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.834529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:34.944951 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47669fd7-b527-46d0-abfb-40159dbc3ef2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.950652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0a293-a231-4da3-9754-98db953791d7 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:34.983170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.983698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.983977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.984278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.984977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:34.985287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.986704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.986808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2dd29-315a-411f-8dad-c37177ec4919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:34.987414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2dd29-315a-411f-8dad-c37177ec4919 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:34.987695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2dd29-315a-411f-8dad-c37177ec4919 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:34.987971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2dd29-315a-411f-8dad-c37177ec4919 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:34.988759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2dd29-315a-411f-8dad-c37177ec4919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:34.989070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2dd29-315a-411f-8dad-c37177ec4919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:34.990483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2dd29-315a-411f-8dad-c37177ec4919 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:34.998094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 414/831] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:34.998867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.006585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 418/832] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:35.007842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504945-98c6-4ccc-8d2a-ee73bb7056e0 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.008129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504945-98c6-4ccc-8d2a-ee73bb7056e0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.008477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4504945-98c6-4ccc-8d2a-ee73bb7056e0 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.009785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 419/833] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:35.011382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4504945-98c6-4ccc-8d2a-ee73bb7056e0 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.014598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.017213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.095693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323ed6d-2668-4ed3-84d0-baf68c4b649d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.110697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4504945-98c6-4ccc-8d2a-ee73bb7056e0 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.128858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.129496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.129779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.130056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.139820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:35.145027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:35.145996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:32:35.146830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:35.147482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653439-7325-4924-8388-fbad6ca82322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.147482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653439-7325-4924-8388-fbad6ca82322 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.147482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653439-7325-4924-8388-fbad6ca82322 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.147689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 415/834] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:35.147757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653439-7325-4924-8388-fbad6ca82322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.147833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.147910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653439-7325-4924-8388-fbad6ca82322 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=344aa2356f0c4d8fb88e7c35603a65c0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:35.147910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653439-7325-4924-8388-fbad6ca82322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:35.148794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653439-7325-4924-8388-fbad6ca82322 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:35.155323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 420/835] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/role_assignments?user.id=344aa2356f0c4d8fb88e7c35603a65c0&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:35.156504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ca8f-836b-4e8d-9fa6-a094929b518a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.157038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ca8f-836b-4e8d-9fa6-a094929b518a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.157038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99ca8f-836b-4e8d-9fa6-a094929b518a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.176352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4e99ca8f-836b-4e8d-9fa6-a094929b518a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:35.177591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4e99ca8f-836b-4e8d-9fa6-a094929b518a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:35.234406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.245736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.254901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 421/836] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:35.255771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ca8f-836b-4e8d-9fa6-a094929b518a None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.265470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d65621-d6cf-48ce-a742-3bbe9d9dcb53 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.312499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.313530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.314561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.314561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/2023824207074cc89a027c15b8425474/roles/61ca3da5b31d4366a080ece9048a5ba8` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.331477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=2023824207074cc89a027c15b8425474, role_id=61ca3da5b31d4366a080ece9048a5ba8)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:35.333512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:35.387051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99ca8f-836b-4e8d-9fa6-a094929b518a None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.410359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 416/837] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:35 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/2023824207074cc89a027c15b8425474/roles/61ca3da5b31d4366a080ece9048a5ba8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:35.434651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.435288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.435572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.435856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.436668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:35.436988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:35.438530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:35.449595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 422/838] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:35.454943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.526634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.571423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3c594-d55d-47af-8a89-aedd29db8859 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.598833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.604678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.614589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.614777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.615056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.615222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.626796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:35.628870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:35.645690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:35.646691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:35.647944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:35.647944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:35.647944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:35.647944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 417/839] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:35.653090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.656165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e5408-e3ff-4c75-aac4-d6e7c25018ad None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.698635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.699550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.699977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.700442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.701176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:35.702680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:35.712573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:35.713778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:35.714620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:35.717288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 423/840] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:35.725116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.769851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52240e8b-fddb-46fa-8714-a19b13f408ed None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.816397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.817275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.817275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.817417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.818050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:35.818348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:35.819870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:35.837372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 418/841] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:35.838386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.865783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3bb34-73e5-4b74-a510-85412bdd84d6 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:35.890474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.896446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:35.903361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:35.903975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:35.904300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:35.904638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:35.906584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:35.906584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:35.906918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:35.914344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 424/842] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:35.919766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:35.971043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96617926-5a09-41c3-b15d-33ef4b2c737f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:36.010709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:36.011578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:36.011928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:36.012300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:36.020586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:36.022183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:36.035109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:36.036056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 22 05:32:36.037013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:36.038580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c666010-140f-4b75-8221-51033d7bc6b1 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:36.040924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 419/843] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:36.042190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:36.076909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:36.077448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:36.077735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:36.078013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:36.079756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:36.080136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:36.082070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:36.088306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 425/844] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:36.157701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:36.162564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c2159-a6bb-4abb-9055-1dd567247233 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:36.200079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:36.200765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:36.201180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:36.201464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:36.202226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:36.202545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:36.204089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:36.226794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 420/845] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Aug 22 05:32:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:36.232636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:36.286837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:36.338451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce8ba3-f507-489d-9f68-cccbfa1f3ee5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:36.372993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:36.373632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:36.373915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:36.374194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:36.446534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:36.448782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:36.499995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:36.553948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 426/846] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:32:36.561375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:36.669258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea47c1-68fb-4092-a4f0-2b24e0c493aa None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:36.704276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:36.704909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:36.705198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:36.705476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:36.716347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:36.717794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:36.732896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:36.733830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:36.735082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:36.735082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:36.735082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:36.735082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 421/847] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:36.739634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:36.842300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56521def-18a5-4cf4-abd1-576ead893239 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:36.879091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:36.880028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:36.880506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:36.880957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:36.881776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:36.882284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:36.883828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:36.896136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 427/848] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:36.908214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:36.913435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:37.003161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2199c-3e6b-49dc-86a4-99c7468e5d91 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:37.037502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:37.038186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.038472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.038750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.045599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:37.047052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:37.058560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:37.059447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:37.060566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 422/849] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:37.066372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:37.079318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:37.171232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90a119-59f2-45a5-830d-5edd5249474f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:37.207041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e73f-d316-405d-b2ef-99ed7e0e232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:37.207981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e73f-d316-405d-b2ef-99ed7e0e232d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.208543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e73f-d316-405d-b2ef-99ed7e0e232d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.208998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e73f-d316-405d-b2ef-99ed7e0e232d None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.210112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477e73f-d316-405d-b2ef-99ed7e0e232d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:37.210613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477e73f-d316-405d-b2ef-99ed7e0e232d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:37.212223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477e73f-d316-405d-b2ef-99ed7e0e232d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:37.225139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 428/850] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:37.233476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:37.292853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012523d3-aee3-4ae9-b5fa-e07f72f84e7a None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.293063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012523d3-aee3-4ae9-b5fa-e07f72f84e7a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.293322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012523d3-aee3-4ae9-b5fa-e07f72f84e7a None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.294794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 429/851] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:37.300382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2828d3-1b18-4998-9529-a748ecf9dcc6 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.300673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2828d3-1b18-4998-9529-a748ecf9dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.300940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2828d3-1b18-4998-9529-a748ecf9dcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.319174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:37.319523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4f2828d3-1b18-4998-9529-a748ecf9dcc6 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:37.320818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4f2828d3-1b18-4998-9529-a748ecf9dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:37.352765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b1f5-0c11-4ea5-ad09-92fbe5a6674e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:37.388616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:37.389261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19ff2f-1d74-4c4b-a760-93d8e5f7cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:37.389962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ff2f-1d74-4c4b-a760-93d8e5f7cf40 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.390249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ff2f-1d74-4c4b-a760-93d8e5f7cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.390530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19ff2f-1d74-4c4b-a760-93d8e5f7cf40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.391268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19ff2f-1d74-4c4b-a760-93d8e5f7cf40 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=9800dbdc23794d9eb02e3c2002b096b2) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:37.391582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19ff2f-1d74-4c4b-a760-93d8e5f7cf40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:37.393655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19ff2f-1d74-4c4b-a760-93d8e5f7cf40 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:37.394940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 430/852] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:37.400081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 423/853] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:37 2022] GET /identity/v3/role_assignments?user.id=9800dbdc23794d9eb02e3c2002b096b2&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:37.402555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad2d14-3dc0-4a73-80b0-55858a1d0246 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.408361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad2d14-3dc0-4a73-80b0-55858a1d0246 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.408361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad2d14-3dc0-4a73-80b0-55858a1d0246 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.408361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 431/854] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:37.414883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ff5d-7f21-4eea-809e-f54e45ba805a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.415171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ff5d-7f21-4eea-809e-f54e45ba805a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.415464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6ff5d-7f21-4eea-809e-f54e45ba805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.436406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-39e6ff5d-7f21-4eea-809e-f54e45ba805a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:37.437650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-39e6ff5d-7f21-4eea-809e-f54e45ba805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:37.513413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 424/855] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:37.674078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad2d14-3dc0-4a73-80b0-55858a1d0246 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:37.782358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad2d14-3dc0-4a73-80b0-55858a1d0246 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:37.784790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ff5d-7f21-4eea-809e-f54e45ba805a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:37.824272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:37.824917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.825202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.825482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.826544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:37.828569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:37.841316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:37.843164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:37.844299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 432/856] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Aug 22 05:32:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:37.849308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:37.854486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:37.898569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6ff5d-7f21-4eea-809e-f54e45ba805a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:37.936243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:37.938467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:37.939119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:37.939405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:37.939687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:37.951340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:37.956766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:37.958903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:32:37.961209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:37.964245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 425/857] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:32:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:37.965445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:37.979832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb62299-fdf6-4aa2-bd78-e70e14d92da4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.025896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.027023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.027462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.028053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.029253 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:38.030022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.032010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.042186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 433/858] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:38.043669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:38.079352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7e943-99bb-470e-b3b9-667aa97fad77 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.103411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:38.116123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.116761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.117041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.117315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.117980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:38.118284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.119714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.133746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 426/859] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:32:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:38.134866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:38.162600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153011d2-6db4-4c6d-b46c-58515096b1a0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.191148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:38.199731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854e3cd-a230-4a6c-bda7-b14404115c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.200555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e3cd-a230-4a6c-bda7-b14404115c85 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.200845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e3cd-a230-4a6c-bda7-b14404115c85 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.207879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854e3cd-a230-4a6c-bda7-b14404115c85 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.207879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e3cd-a230-4a6c-bda7-b14404115c85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:38.207879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e3cd-a230-4a6c-bda7-b14404115c85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.207879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854e3cd-a230-4a6c-bda7-b14404115c85 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.208814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 434/860] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:38.210488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f0f41-e49f-4955-932f-558c3ec0ef9a None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.210917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f0f41-e49f-4955-932f-558c3ec0ef9a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.211339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f0f41-e49f-4955-932f-558c3ec0ef9a None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.213139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 435/861] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:38.219202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ba69e-077d-40dd-b7bf-241ad9df3d2b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.219806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ba69e-077d-40dd-b7bf-241ad9df3d2b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.221322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ba69e-077d-40dd-b7bf-241ad9df3d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.245463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c75ba69e-077d-40dd-b7bf-241ad9df3d2b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:38.247545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c75ba69e-077d-40dd-b7bf-241ad9df3d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:38.259169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3c38a-062c-46b6-8734-e7aaeb019747 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.301050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.301761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.302112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.302392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.315755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.317421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:38.334376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:38.335411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:38.336354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:38.336354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:38.336354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:38.336354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 427/862] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:38.341377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:38.357037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 436/863] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:38.387569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:38.456825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a28bb-ca5e-48fa-ac11-4103faafa61d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.491956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.492583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.492868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.493145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.493799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:38.494108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.495483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.507888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 428/864] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:38.513408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ba69e-077d-40dd-b7bf-241ad9df3d2b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:38.616809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ba69e-077d-40dd-b7bf-241ad9df3d2b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.639344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:38.647430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:38.650734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.651379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.651660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.651935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.659707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.661170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:38.672665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:38.673635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:38.676245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 437/865] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:32:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:38.679957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:38.766901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:38.775389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38f08f-c048-4360-9f38-d98b3e21c24b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.781485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adef3f0-22be-47d6-a51f-3b3c53e093e5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:38.816820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.817485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.817834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.818200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.818992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:38.819417 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.821013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.821892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:38.823167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:38.824348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:38.824728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:38.825461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:38.826965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:38.840568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 438/866] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Aug 22 05:32:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:38.847307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:38.911919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 429/867] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:38 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:32:38.934426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:38.988433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b42cf-6bd7-4636-a621-4c6d2f0b3a46 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:39.034142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:39.034683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:39.034963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:39.035239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:39.106944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:39.108413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:39.144976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:39.216397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 439/868] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:38 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 05:32:39.223039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:39.327535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3629293-0512-43fb-8868-f5a35611fa32 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:39.362225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b33a2-f540-47e2-a763-532f1599d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:39.362861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b33a2-f540-47e2-a763-532f1599d70d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:39.363142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b33a2-f540-47e2-a763-532f1599d70d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:39.363417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b33a2-f540-47e2-a763-532f1599d70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:39.374677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b33a2-f540-47e2-a763-532f1599d70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:39.376174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b33a2-f540-47e2-a763-532f1599d70d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-562b33a2-f540-47e2-a763-532f1599d70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:39.392240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:39.393912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:39.394796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:39.394796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:39.394796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:39.394796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 430/869] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:39.401569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:39.407593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f73e-c774-45ce-a8f9-7e099e7ca76b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:39.407884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f73e-c774-45ce-a8f9-7e099e7ca76b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:39.408163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572f73e-c774-45ce-a8f9-7e099e7ca76b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:39.409656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 431/870] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:32:39.414781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341539-fdad-4478-ac07-e9101a6f6ad8 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:39.415292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341539-fdad-4478-ac07-e9101a6f6ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:39.415775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4341539-fdad-4478-ac07-e9101a6f6ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:39.433533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c4341539-fdad-4478-ac07-e9101a6f6ad8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:39.435147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c4341539-fdad-4478-ac07-e9101a6f6ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:39.437508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:39.513339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 432/871] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:39.527441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b9208-b8ee-4545-9d8a-4b5bf4a225ff None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:39.562322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:39.563300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:39.563790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:39.564413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:39.565796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:39.566311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:39.567892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:39.576474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:39.583951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 440/872] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:39.586960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341539-fdad-4478-ac07-e9101a6f6ad8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:39.690495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4341539-fdad-4478-ac07-e9101a6f6ad8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:39.736036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:39.737412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:39.738012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:39.738514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:39.745995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:39.747791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:39.749965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:39.761720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:39.762694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:39.763627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:39.766105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 433/873] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:39.772905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:39.841707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:39.890255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0901b0c-8853-4c63-822a-a122e9d5e652 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:39.945914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:39.946562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:39.946855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:39.947269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:39.947995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:39.948348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:39.950566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:39.972115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 441/874] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:39.973414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:39.981917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f9459-37c0-421b-b96f-5e24044321ce None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:40.028496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:40.029152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.029440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.029722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.030327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:40.032382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:40.036739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:40.046593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:40.047809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:40.048699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:40.052275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 434/875] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:40.053919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:40.093781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d8a4f-513c-4046-ad8c-6262133f21f0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:40.130927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:40.131536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.131825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.132107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.132510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:40.132867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=2023824207074cc89a027c15b8425474) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:40.133200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:40.134620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:40.148521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 442/876] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:39 2022] GET /identity/v3/role_assignments?user.id=2023824207074cc89a027c15b8425474&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:40.185186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c6ac0-ec41-47d2-9d92-fd3cb1198dd0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:40.226974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b62d3-9f7c-43d5-817b-bf51df7fa50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:40.227592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b62d3-9f7c-43d5-817b-bf51df7fa50c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.227913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b62d3-9f7c-43d5-817b-bf51df7fa50c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.228207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b62d3-9f7c-43d5-817b-bf51df7fa50c None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.228865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b62d3-9f7c-43d5-817b-bf51df7fa50c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:40.229176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b62d3-9f7c-43d5-817b-bf51df7fa50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:40.230570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b62d3-9f7c-43d5-817b-bf51df7fa50c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:40.236399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 435/877] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:40.242322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:40.292291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bafc91-9a0a-4d27-848c-8ba821ed403f None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.292596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bafc91-9a0a-4d27-848c-8ba821ed403f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.292882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bafc91-9a0a-4d27-848c-8ba821ed403f None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.294368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 436/878] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:40.299710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8ae2-47bf-4323-bf9d-faae4dfc847d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.299999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8ae2-47bf-4323-bf9d-faae4dfc847d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.300391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e8ae2-47bf-4323-bf9d-faae4dfc847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.325106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-087e8ae2-47bf-4323-bf9d-faae4dfc847d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:40.326300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-087e8ae2-47bf-4323-bf9d-faae4dfc847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:40.368143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4638bd25-6279-447b-bee7-1970c2ff2bfc None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:40.394330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:40.402958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 437/879] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:40 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:40.415163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2578d56-8343-4044-9036-d4c40fe83a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:40.415782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578d56-8343-4044-9036-d4c40fe83a42 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.416066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578d56-8343-4044-9036-d4c40fe83a42 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.416403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2578d56-8343-4044-9036-d4c40fe83a42 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.417049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2578d56-8343-4044-9036-d4c40fe83a42 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:40.417388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2578d56-8343-4044-9036-d4c40fe83a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:40.418763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2578d56-8343-4044-9036-d4c40fe83a42 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:40.425624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 443/880] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:40.678197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8ae2-47bf-4323-bf9d-faae4dfc847d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:40.738619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:40.783422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e8ae2-47bf-4323-bf9d-faae4dfc847d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:40.818903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d16b42-c14d-4efb-b15e-c474e952be04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:40.819509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d16b42-c14d-4efb-b15e-c474e952be04 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.819794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d16b42-c14d-4efb-b15e-c474e952be04 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.820071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d16b42-c14d-4efb-b15e-c474e952be04 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.820761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d16b42-c14d-4efb-b15e-c474e952be04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:40.822141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d16b42-c14d-4efb-b15e-c474e952be04 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:40.932825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 438/881] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:40 2022] POST /identity/v3/services => generated 269 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:40.975968 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ef17-2497-4bc8-aa48-ec17637179bf None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.976531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ef17-2497-4bc8-aa48-ec17637179bf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.976531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ef17-2497-4bc8-aa48-ec17637179bf None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:40.978409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 444/882] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:40.984487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ccfb5-870c-45dd-a2fe-03eb0138053a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:40.984794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ccfb5-870c-45dd-a2fe-03eb0138053a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:40.985105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ccfb5-870c-45dd-a2fe-03eb0138053a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:41.004837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-892ccfb5-870c-45dd-a2fe-03eb0138053a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:41.006063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-892ccfb5-870c-45dd-a2fe-03eb0138053a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:41.086941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 439/883] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:41.359413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990ef17-2497-4bc8-aa48-ec17637179bf None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:41.466449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990ef17-2497-4bc8-aa48-ec17637179bf None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:41.501326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:41.501961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:41.502268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:41.502541 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:41.503126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:41.504514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:41.513289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:41.514284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:41.515127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 445/884] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:41.520816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ccfb5-870c-45dd-a2fe-03eb0138053a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:41.572726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:41.624510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ccfb5-870c-45dd-a2fe-03eb0138053a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:41.658939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:41.659548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:41.659832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:41.660113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:41.660776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:41.661085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:41.662464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:41.668107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 440/885] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:41.673708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:41.724422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:41.774481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc87d15-7f30-457a-8b01-eb6b615a67dc None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:41.810413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:41.811027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:41.811311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:41.811590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:41.812263 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:41.812578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:41.814024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:41.819343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 446/886] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:41.825285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:41.928442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94500d-d6d0-4cde-b77b-bb1b454e4c87 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:41.938287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:41.964032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a96341-d46c-44dd-a08a-3f51ff0564fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:41.964685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96341-d46c-44dd-a08a-3f51ff0564fb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:41.965022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96341-d46c-44dd-a08a-3f51ff0564fb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:41.965304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a96341-d46c-44dd-a08a-3f51ff0564fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:41.966017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96341-d46c-44dd-a08a-3f51ff0564fb None admin] RBAC: Adding query filter params (interface=public, service_id=642ec2579d284e3090af652901181f5d, region_id=RegionOne) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:41.966330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96341-d46c-44dd-a08a-3f51ff0564fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:41.967698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a96341-d46c-44dd-a08a-3f51ff0564fb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:41.977027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 441/887] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:32:41 2022] GET /identity/v3/endpoints?service_id=642ec2579d284e3090af652901181f5d&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:41.982507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:42.091420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611ff61-4d65-4cd4-9823-0f89eefe63f9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:42.107705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:42.128881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef37d26-05e1-4dfa-b260-2928b4cfcd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:42.129500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef37d26-05e1-4dfa-b260-2928b4cfcd69 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:42.129788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef37d26-05e1-4dfa-b260-2928b4cfcd69 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:42.130067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef37d26-05e1-4dfa-b260-2928b4cfcd69 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:42.130676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef37d26-05e1-4dfa-b260-2928b4cfcd69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:42.132046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef37d26-05e1-4dfa-b260-2928b4cfcd69 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:42.138066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 447/888] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:32:41 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:32:42.331661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151148e5-fe70-4be9-8d62-5cb78ab19ba3 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:42.332432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151148e5-fe70-4be9-8d62-5cb78ab19ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:42.332919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151148e5-fe70-4be9-8d62-5cb78ab19ba3 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:42.335118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 442/889] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:42.340092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ea3b-35fd-4577-8ace-b8e7bec1ecfa None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:42.340430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ea3b-35fd-4577-8ace-b8e7bec1ecfa None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:42.340704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea9ea3b-35fd-4577-8ace-b8e7bec1ecfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:42.359041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-dea9ea3b-35fd-4577-8ace-b8e7bec1ecfa None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:42.360265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-dea9ea3b-35fd-4577-8ace-b8e7bec1ecfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:42.406390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aea0cc-5392-4e6b-8fbb-80de0b3f6a7d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:42.406712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aea0cc-5392-4e6b-8fbb-80de0b3f6a7d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:42.406953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aea0cc-5392-4e6b-8fbb-80de0b3f6a7d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:42.408588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 443/890] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:42.413654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f310c6-777a-47d0-b803-6845290809cb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:42.413936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f310c6-777a-47d0-b803-6845290809cb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:42.414211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f310c6-777a-47d0-b803-6845290809cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:42.435512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-14f310c6-777a-47d0-b803-6845290809cb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:42.436738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-14f310c6-777a-47d0-b803-6845290809cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:42.439346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 448/891] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:42.514147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 444/892] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:42.710119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ea3b-35fd-4577-8ace-b8e7bec1ecfa None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:42.795571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f310c6-777a-47d0-b803-6845290809cb None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:42.818593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea9ea3b-35fd-4577-8ace-b8e7bec1ecfa None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:42.826121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:42.855014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:42.855643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:42.855923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:42.856214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:42.867000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:42.871721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:42.872682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:42.873542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 449/893] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Aug 22 05:32:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:42.881206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:42.898238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:42.901470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f310c6-777a-47d0-b803-6845290809cb None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:42.936342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d937602c-6769-40e5-a236-6bf1c006110f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:42.936948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937602c-6769-40e5-a236-6bf1c006110f None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:42.937231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937602c-6769-40e5-a236-6bf1c006110f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:42.937508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d937602c-6769-40e5-a236-6bf1c006110f None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:42.938153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937602c-6769-40e5-a236-6bf1c006110f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:42.940118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d937602c-6769-40e5-a236-6bf1c006110f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:42.982180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30726-2bf0-4596-8f01-c473b1e712c0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.016306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 445/894] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:42 2022] POST /identity/v3/services => generated 241 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:32:43.016306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f881-af1b-4037-a8fa-1c675ae39ecb None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.016306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f881-af1b-4037-a8fa-1c675ae39ecb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.016306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f881-af1b-4037-a8fa-1c675ae39ecb None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.021751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 446/895] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:43.023492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038df3ae-0dc5-4fdd-9646-0abdf135fecb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.023810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038df3ae-0dc5-4fdd-9646-0abdf135fecb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.024217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038df3ae-0dc5-4fdd-9646-0abdf135fecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.030396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.031887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.032371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.032657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.033970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:43.034236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.035674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.045833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-038df3ae-0dc5-4fdd-9646-0abdf135fecb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:43.047482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-038df3ae-0dc5-4fdd-9646-0abdf135fecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:43.051211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 450/896] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Aug 22 05:32:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:43.052386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.090331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:43.132010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 447/897] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:43.179573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e108-7e50-4fc0-97e8-d3f1905e927f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.216734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.217377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.217665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.217951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.228877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.230484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:43.246343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:43.247312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:43.248257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:43.248257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:43.248257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:43.248257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 451/898] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:43.255164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038df3ae-0dc5-4fdd-9646-0abdf135fecb None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.363284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:43.373543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038df3ae-0dc5-4fdd-9646-0abdf135fecb None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.409567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.410814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.411270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.411741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.411847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.412786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:43.413261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.414976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.427960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 448/899] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:43.434239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.498154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:43.523146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9535a-bdd1-49fe-aca6-f53c7bbe6bea None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.544477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e72aef-9dde-40a0-a5fc-e52794d52c60 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.561109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.561757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.562049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.562321 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.562919 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.565068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:43.574599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:43.575558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:43.576531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 452/900] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:43.581419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.595922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.597240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.597710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.598634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.610150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.613072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:43.629226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:43.630225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:43.631166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 449/901] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:43.637698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.651304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:43.710741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325418e6-11df-48e9-af9a-4c8ebd58f5bf None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.746702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.747386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.747672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.747953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.748667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:43.748915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.750282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.759970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 453/902] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:43.760371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9ede3-4cf4-48c5-a2db-8e50e11c1376 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.760866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.766118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:43.807133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.808106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.808612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.808848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.809598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:43.809983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.811341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.836096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 450/903] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:43.837126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.882884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b6185-18c2-49fc-ad00-dd29d7ce9ba5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.907017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:43.926973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.927891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.928400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.928863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:43.930087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:43.930844 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:43.932931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:43.940798 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 454/904] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:43.945479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7a0ce-e2ce-496f-b7d0-ef97024756a4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:43.946800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:43.990552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca1d31-54d3-41c8-9f77-1792e53846e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:43.991169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca1d31-54d3-41c8-9f77-1792e53846e0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:43.991453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca1d31-54d3-41c8-9f77-1792e53846e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:43.991731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca1d31-54d3-41c8-9f77-1792e53846e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.022300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:44.060164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8c9a-f110-4b0a-9087-dc04351de65b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:44.081498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca1d31-54d3-41c8-9f77-1792e53846e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.082975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ca1d31-54d3-41c8-9f77-1792e53846e0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.100512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fce3e-f218-451b-9d71-ae0ebfcad007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:44.101770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fce3e-f218-451b-9d71-ae0ebfcad007 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.102269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fce3e-f218-451b-9d71-ae0ebfcad007 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.102756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fce3e-f218-451b-9d71-ae0ebfcad007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.103661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fce3e-f218-451b-9d71-ae0ebfcad007 None admin] RBAC: Adding query filter params (interface=public, service_id=a69f9def7b09460ebc7b16d8b3d9ede0, region_id=RegionOne) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:44.104283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fce3e-f218-451b-9d71-ae0ebfcad007 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.105960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fce3e-f218-451b-9d71-ae0ebfcad007 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.112235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 455/905] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/endpoints?service_id=a69f9def7b09460ebc7b16d8b3d9ede0&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:44.113882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fd9cb-6c0b-474f-898c-50c1cbcf6f62 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.114452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fd9cb-6c0b-474f-898c-50c1cbcf6f62 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.115023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fd9cb-6c0b-474f-898c-50c1cbcf6f62 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.116833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 456/906] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:44.117961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fd9cb-6c0b-474f-898c-50c1cbcf6f62 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.156518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:44.199144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 451/907] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:43 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:32:44.200476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d053ae5-4811-4ba9-911c-bda89d266669 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.200773 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d053ae5-4811-4ba9-911c-bda89d266669 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.201055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d053ae5-4811-4ba9-911c-bda89d266669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.218470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-3d053ae5-4811-4ba9-911c-bda89d266669 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:44.219632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3d053ae5-4811-4ba9-911c-bda89d266669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:44.227588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fd9cb-6c0b-474f-898c-50c1cbcf6f62 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:44.261305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:44.266598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:44.267345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.267559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.267796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.268473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.269907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.284435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 457/908] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:32:44.284435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.306328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 452/909] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:44.415014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0b7d3-ce9d-4a9f-b427-3d711e46c49e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:44.453692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:44.454325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.454607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.454880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.466062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.467496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:44.484583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:44.485607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:44.487091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:44.487091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:44.487091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:44.487091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 458/910] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:44.492133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d053ae5-4811-4ba9-911c-bda89d266669 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.576939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.594346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:44.598602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d053ae5-4811-4ba9-911c-bda89d266669 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:44.631747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:44.643703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:44.644952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.645381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.645673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.646640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:44.646962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.648623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.668348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 453/911] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:44.669663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.703111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e29415-5f22-45eb-95d6-b5c2d1812b04 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:44.738938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:44.739909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.740473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.740945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.741723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.743289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:44.752288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:44.753329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 22 05:32:44.754250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:44.756975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 459/912] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:44.762970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.789445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c2213-90d6-450d-a475-410dba84f42e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:44.832828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:44.834271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.834769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.835241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.844084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.846414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:44.860816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:44.862391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:44.863292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:44.870128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 454/913] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:44.871690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.882057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a05bdb-8370-476b-96cc-75dba26de5fd None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:44.898089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:44.900003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:44.929377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:44.930608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:44.931093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:44.931697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:44.932958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:44.933779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:44.935496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:44.942381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 460/914] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:44.948876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:44.997377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90121b8-99ed-4633-a7be-a9f5cab0c70e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:45.035235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d381d-b113-45ec-ba33-e33973aad184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:45.035836 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d381d-b113-45ec-ba33-e33973aad184 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.036116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d381d-b113-45ec-ba33-e33973aad184 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.036417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d381d-b113-45ec-ba33-e33973aad184 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.037104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d381d-b113-45ec-ba33-e33973aad184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:45.037461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d381d-b113-45ec-ba33-e33973aad184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:45.038889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d381d-b113-45ec-ba33-e33973aad184 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:45.050446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 455/915] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:45.051600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134f303-5166-4bbf-ae92-10390e9c7eec None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.051890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134f303-5166-4bbf-ae92-10390e9c7eec None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.052170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134f303-5166-4bbf-ae92-10390e9c7eec None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.056446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 456/916] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:45.056446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134f303-5166-4bbf-ae92-10390e9c7eec None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:45.074429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c27e5c-32a4-4366-92f2-b4d82495fd4c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:45.111970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be0e57-e99a-4a71-a9b4-82983a21385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:45.112726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be0e57-e99a-4a71-a9b4-82983a21385a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.113015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be0e57-e99a-4a71-a9b4-82983a21385a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.113291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be0e57-e99a-4a71-a9b4-82983a21385a None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.114228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be0e57-e99a-4a71-a9b4-82983a21385a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:45.114402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be0e57-e99a-4a71-a9b4-82983a21385a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:45.115777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54be0e57-e99a-4a71-a9b4-82983a21385a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:45.126100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 461/917] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Aug 22 05:32:44 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:45.126100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33e34-6b77-4a47-8ab5-9a5a67cb8be3 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.126100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33e34-6b77-4a47-8ab5-9a5a67cb8be3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.126100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca33e34-6b77-4a47-8ab5-9a5a67cb8be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.141985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6ca33e34-6b77-4a47-8ab5-9a5a67cb8be3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:45.143690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6ca33e34-6b77-4a47-8ab5-9a5a67cb8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:45.145896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:45.169053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134f303-5166-4bbf-ae92-10390e9c7eec None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:45.180463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:45.203215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:45.203811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.204130 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.204434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.205776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] RBAC: Adding query filter params (role.id=0d86157ab7ad4f868971f9264e092bb0, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=2023824207074cc89a027c15b8425474) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:45.206086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:45.207509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:45.213567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 457/918] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:45 2022] GET /identity/v3/role_assignments?user.id=2023824207074cc89a027c15b8425474&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0d86157ab7ad4f868971f9264e092bb0 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:45.214334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:45.220465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 462/919] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:45.334869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d130b-36f0-476b-ab7f-7eb5fb64d748 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:45.372360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:45.373295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.373793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.374296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.375177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:45.376783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:45.451630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:45.462014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 458/920] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:32:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:45.516142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca33e34-6b77-4a47-8ab5-9a5a67cb8be3 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:45.632267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca33e34-6b77-4a47-8ab5-9a5a67cb8be3 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:45.673529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:45.674993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.675479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.675935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.676735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:45.678410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:45.687617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:45.688678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:45.690133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:45.692659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 463/921] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:45.698629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:45.803479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3172d5d-00dc-4d48-852a-d906e0bffb6d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:45.840464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:45.841353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:45.841799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:45.842231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:45.843015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:45.843483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:45.845032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:45.850502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 459/922] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:45.856313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:45.890390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:45.965118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdc380-e263-4a72-9574-e1ae3c033bee None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:46.000185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:46.001201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:46.001684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:46.002733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:46.003467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:46.003874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:46.005363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:46.011008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 464/923] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:46.016724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:46.083361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:46.121838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77239a9a-8460-48ce-a2be-fd6528ac77dc None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:46.157176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8e97f-d52d-4ff3-8166-b77380d983ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:46.157718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e97f-d52d-4ff3-8166-b77380d983ec None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:46.158024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e97f-d52d-4ff3-8166-b77380d983ec None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:46.158307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8e97f-d52d-4ff3-8166-b77380d983ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:46.159012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8e97f-d52d-4ff3-8166-b77380d983ec None admin] RBAC: Adding query filter params (interface=public, service_id=dfa12126a5c34520abcf08d235acf68d, region_id=RegionOne) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:46.159323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8e97f-d52d-4ff3-8166-b77380d983ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:46.160736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8e97f-d52d-4ff3-8166-b77380d983ec None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:46.166564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 460/924] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:32:46 2022] GET /identity/v3/endpoints?service_id=dfa12126a5c34520abcf08d235acf68d&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:46.172144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:46.271129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:46.278465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500cd43-7d9a-4e26-9292-ba4dfd264ac3 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:46.319064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:46.319822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:46.320221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:46.320605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:46.321311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:46.322863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:46.323668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108ce2-3f5d-4b2f-a54f-8f20470cce68 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:46.323957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108ce2-3f5d-4b2f-a54f-8f20470cce68 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:46.324262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a108ce2-3f5d-4b2f-a54f-8f20470cce68 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:46.325747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 461/925] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:46.330866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 465/926] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:32:46 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:32:46.331601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0fd49-c590-4f8d-8d38-edc5130f6b04 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:46.331897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0fd49-c590-4f8d-8d38-edc5130f6b04 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:46.332179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0fd49-c590-4f8d-8d38-edc5130f6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:46.352121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4af0fd49-c590-4f8d-8d38-edc5130f6b04 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:46.353393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4af0fd49-c590-4f8d-8d38-edc5130f6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:46.432655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 462/927] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:46.701631 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:46.805970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb655b-89fe-4eaa-b2e7-4cbc7826688c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:46.842015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:46.842647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:46.842930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:46.843212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:46.843802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:46.845253 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:46.853889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:46.854808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:46.856099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 466/928] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Aug 22 05:32:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:46.861224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0fd49-c590-4f8d-8d38-edc5130f6b04 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:46.922296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:46.966163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0fd49-c590-4f8d-8d38-edc5130f6b04 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:47.005185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f473a-72e4-429a-9718-e2f6f492b81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:47.005796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f473a-72e4-429a-9718-e2f6f492b81a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.006075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f473a-72e4-429a-9718-e2f6f492b81a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.006345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f473a-72e4-429a-9718-e2f6f492b81a None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.007085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f473a-72e4-429a-9718-e2f6f492b81a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:47.007392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f473a-72e4-429a-9718-e2f6f492b81a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:47.008793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f473a-72e4-429a-9718-e2f6f492b81a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:47.014107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 463/929] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:47.020000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:47.060562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:47.123074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde7a3-f87e-403a-beb8-d996d860c062 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.123586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde7a3-f87e-403a-beb8-d996d860c062 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.123662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cde7a3-f87e-403a-beb8-d996d860c062 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.125349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 464/930] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:47.131692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6cdf3-2f88-4d85-a0ca-4159610d11ff None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.131973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6cdf3-2f88-4d85-a0ca-4159610d11ff None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.132270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6cdf3-2f88-4d85-a0ca-4159610d11ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.133943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71369a2-b2ba-4f3a-95ea-113fde498ba3 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:47.155448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1df6cdf3-2f88-4d85-a0ca-4159610d11ff None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:47.156664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1df6cdf3-2f88-4d85-a0ca-4159610d11ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:47.171648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:47.172587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.173502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.174533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.175379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:47.175900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:47.177487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:47.183003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 467/931] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:47.192221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:47.251540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 465/932] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:47.289488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:47.305323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17bb1b-f869-4458-8c50-a882d6d21c1f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:47.341393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb6b93-6ef4-4b76-bec5-2718852f941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:47.342007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb6b93-6ef4-4b76-bec5-2718852f941a None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.342293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb6b93-6ef4-4b76-bec5-2718852f941a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.342571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb6b93-6ef4-4b76-bec5-2718852f941a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.343249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb6b93-6ef4-4b76-bec5-2718852f941a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:47.344659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb6b93-6ef4-4b76-bec5-2718852f941a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:47.447791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 468/933] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:32:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:47.539728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6cdf3-2f88-4d85-a0ca-4159610d11ff None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:47.574486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438b7b-a415-40dc-a69d-8c8b5fc745a1 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.574801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438b7b-a415-40dc-a69d-8c8b5fc745a1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.575129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a438b7b-a415-40dc-a69d-8c8b5fc745a1 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.576792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 469/934] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:32:47.586573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595644d-1380-45ee-9e48-4d232d5e62d3 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.586867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595644d-1380-45ee-9e48-4d232d5e62d3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.587146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595644d-1380-45ee-9e48-4d232d5e62d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.595062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:47.612414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c595644d-1380-45ee-9e48-4d232d5e62d3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:47.613631 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c595644d-1380-45ee-9e48-4d232d5e62d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:47.657426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6cdf3-2f88-4d85-a0ca-4159610d11ff None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:47.703998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 470/935] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:47.713770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:47.714821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.715291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.715787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.727326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:47.731959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:47.732934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:47.733797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 466/936] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Aug 22 05:32:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:47.739840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595644d-1380-45ee-9e48-4d232d5e62d3 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:47.807694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:47.845912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595644d-1380-45ee-9e48-4d232d5e62d3 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:47.882103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:47.883083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:47.883652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:47.884133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:47.885075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:47.885587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:47.887144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:47.895890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 471/937] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Aug 22 05:32:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:47.901211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:47.997188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.009645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae0d30-b45f-49f9-a170-9cd4c9161f58 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.018782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:48.046651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.047852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.048517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.048896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.060811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.062441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:48.078317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:48.079496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:48.081083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:48.081083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:48.081083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:48.086373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 467/938] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:48.087166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.129734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49cd60c-d666-4d0a-bd6d-ef507cd6d95e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.169195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:48.180290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.181769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.182698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.183277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.184280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.186544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.190743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING keystone.server.flask.common [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 22 05:32:48.201869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0197d-29f1-4e0f-b947-11459b72f840 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.238408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.239055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.239340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.239613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.241023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.sql.core [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 05:32:48.241023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 05:32:48.241023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [parameters: {'id': 'cc5fd453c4a94ac28e98261095da4e75', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 05:32:48.241023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82146) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 05:32:48.244596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:48.245117 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.246837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc5fd453c4a94ac28e98261095da4e75.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc5fd453c4a94ac28e98261095da4e75. Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application conn.query(q) Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 05:32:48.247785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result.read() Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 22 05:32:48.253199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application next(self.gen) Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application yield resource Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application next(self.gen) Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise self.value Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application session.commit() Aug 22 05:32:48.254200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.session.flush() Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application compat.raise_( Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 05:32:48.255099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 05:32:48.256030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application conn.query(q) Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result.read() Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 05:32:48.257273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [parameters: {'id': 'cc5fd453c4a94ac28e98261095da4e75', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.259496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:48.262243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc5fd453c4a94ac28e98261095da4e75. Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 472/939] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Aug 22 05:32:47 2022] POST /identity/v3/projects => generated 262 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:48.265285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.276945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 468/940] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:48.277818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.310126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:48.378314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b644-08ad-4247-94bf-672496151f5c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.401825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cdaa0-b86f-4da2-a9cb-e06ad90ae7ec None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.412653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a1bfe-fd43-488b-9a51-b5485374de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.413749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1bfe-fd43-488b-9a51-b5485374de6c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.414129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1bfe-fd43-488b-9a51-b5485374de6c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.414792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a1bfe-fd43-488b-9a51-b5485374de6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.421794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a1bfe-fd43-488b-9a51-b5485374de6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.423449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a1bfe-fd43-488b-9a51-b5485374de6c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-b75a1bfe-fd43-488b-9a51-b5485374de6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:48.434610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:48.435663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.436776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 473/941] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:48.437269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049a16-39a4-4c96-ab02-dd1c25cc58bf None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.437531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049a16-39a4-4c96-ab02-dd1c25cc58bf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.437810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81049a16-39a4-4c96-ab02-dd1c25cc58bf None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.442387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 474/942] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:48.443094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81049a16-39a4-4c96-ab02-dd1c25cc58bf None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.446361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d3c10-f9cd-40c2-af8a-5cb9d5d5148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.447072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3c10-f9cd-40c2-af8a-5cb9d5d5148f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.447419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3c10-f9cd-40c2-af8a-5cb9d5d5148f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.447792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3c10-f9cd-40c2-af8a-5cb9d5d5148f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.458167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d3c10-f9cd-40c2-af8a-5cb9d5d5148f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.460440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475d3c10-f9cd-40c2-af8a-5cb9d5d5148f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-475d3c10-f9cd-40c2-af8a-5cb9d5d5148f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:48.476116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:48.477269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:48.478404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 469/943] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:48.483695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059b018-9383-4b51-a6d1-cd3af5bdd4ac None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.483695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059b018-9383-4b51-a6d1-cd3af5bdd4ac None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.483695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059b018-9383-4b51-a6d1-cd3af5bdd4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.499791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1059b018-9383-4b51-a6d1-cd3af5bdd4ac None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:48.501005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:48.501192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1059b018-9383-4b51-a6d1-cd3af5bdd4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:48.558521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81049a16-39a4-4c96-ab02-dd1c25cc58bf None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.575778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 470/944] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:48.576721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059b018-9383-4b51-a6d1-cd3af5bdd4ac None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.587350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:48.610616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.612950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.613510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.614051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.615032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:48.615501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.617224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.639209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 475/945] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:48.693028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059b018-9383-4b51-a6d1-cd3af5bdd4ac None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.733489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.734118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.734403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.734682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.735500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:48.735818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.737482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.758893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 471/946] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:48.765386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.860231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.881188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4f362-4131-461d-bea7-d0452d7d069f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:48.889060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:48.918294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:48.919360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:48.919868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:48.920685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:48.932980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:48.934909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:48.946793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:48.952534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:48.953479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:48.954388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:48.954388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:48.954388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:48.956520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 476/947] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:48.962901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:48.988993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17115d-cad1-4001-8a21-73c8ba2d5e1e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.027237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.028016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.028331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.028608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.029236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.030746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:49.040927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:49.041952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:49.042789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 472/948] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:49.049278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:49.092318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93403e3c-bbac-4d96-8b44-9bf3f2a3837c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.128257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.128877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.129146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.129437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.130073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:49.130377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.131740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.148834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 477/949] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:49.150131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:49.169259 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:49.175994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48dc74-ddb4-498f-b6aa-0f09793cd0b8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.217530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.218211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.218588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.218976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.219803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:49.220219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.221832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.223837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:49.232454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 473/950] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:49.234040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:49.270749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e86542-6ecd-4559-a6e1-1b9f5e92c36d None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.333278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.334432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.334911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.335352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.345132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.347747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.350036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93621238-e68e-483b-a1f7-2b869254cfde None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:49.362687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:49.363935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:49.365156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:49.372482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 478/951] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:49.373228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:49.395164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.395775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.396086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.396684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.397106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:49.397415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.398782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.409004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 474/952] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:49.410383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:49.473551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:49.477366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:49.498498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d4656-6cd5-4343-83ec-10a957d94064 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.515888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32829170-95a8-41b7-afc9-c47cd45adc1b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.536120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f00d-d4d1-4619-beb6-e2a7058e4a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.536893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f00d-d4d1-4619-beb6-e2a7058e4a95 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.537262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f00d-d4d1-4619-beb6-e2a7058e4a95 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.537548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f00d-d4d1-4619-beb6-e2a7058e4a95 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.538265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f00d-d4d1-4619-beb6-e2a7058e4a95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:49.538582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f00d-d4d1-4619-beb6-e2a7058e4a95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.540034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f00d-d4d1-4619-beb6-e2a7058e4a95 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.557752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de62af-0c24-4b2a-8869-d61870bcd910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.558643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de62af-0c24-4b2a-8869-d61870bcd910 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.558981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de62af-0c24-4b2a-8869-d61870bcd910 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.559330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de62af-0c24-4b2a-8869-d61870bcd910 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.560538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de62af-0c24-4b2a-8869-d61870bcd910 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.562221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de62af-0c24-4b2a-8869-d61870bcd910 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.563654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 479/953] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:49.565579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4922e9-eab3-4e6a-aab3-a217b59f8ec6 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.565898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4922e9-eab3-4e6a-aab3-a217b59f8ec6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.566206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4922e9-eab3-4e6a-aab3-a217b59f8ec6 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.571643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 480/954] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:49.571643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4922e9-eab3-4e6a-aab3-a217b59f8ec6 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:49.641159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 475/955] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:32:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:32:49.653836 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd9df8-dd68-4fed-a892-8a6d11d544c5 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.654066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd9df8-dd68-4fed-a892-8a6d11d544c5 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.654286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd9df8-dd68-4fed-a892-8a6d11d544c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.683603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4922e9-eab3-4e6a-aab3-a217b59f8ec6 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:49.694368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-48bd9df8-dd68-4fed-a892-8a6d11d544c5 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:49.695589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-48bd9df8-dd68-4fed-a892-8a6d11d544c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:49.743586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:49.745388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:49.745929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:49.746424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/2023824207074cc89a027c15b8425474/roles/0d86157ab7ad4f868971f9264e092bb0` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:49.750408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=2023824207074cc89a027c15b8425474, role_id=0d86157ab7ad4f868971f9264e092bb0)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:49.753622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:49.757430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:49.775061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 476/956] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:49.837097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 481/957] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:32:49 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/2023824207074cc89a027c15b8425474/roles/0d86157ab7ad4f868971f9264e092bb0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:32:50.053552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd9df8-dd68-4fed-a892-8a6d11d544c5 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:50.101715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:50.158407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd9df8-dd68-4fed-a892-8a6d11d544c5 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:50.197050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:50.198088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:50.198580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:50.199064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:50.199862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:50.201588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:50.211635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:50.212887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:50.214057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:50.221169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 477/958] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:50.223619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:50.328020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cb47d-843a-4faf-b3d3-ddaa19a1ea06 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:50.365279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb58a7d-377b-43ad-84c8-8cef80b24e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:50.365888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb58a7d-377b-43ad-84c8-8cef80b24e32 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:50.366168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb58a7d-377b-43ad-84c8-8cef80b24e32 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:50.366441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb58a7d-377b-43ad-84c8-8cef80b24e32 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:50.367074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb58a7d-377b-43ad-84c8-8cef80b24e32 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:50.367376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb58a7d-377b-43ad-84c8-8cef80b24e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:50.368772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb58a7d-377b-43ad-84c8-8cef80b24e32 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:50.374062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 482/959] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:50.379721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:50.484148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f432af-cb4d-4125-b637-d9943dc5ba83 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:50.495906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:50.521401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b0612-2e86-4ab8-9a63-b157d35aec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:50.522003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b0612-2e86-4ab8-9a63-b157d35aec06 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:50.522337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b0612-2e86-4ab8-9a63-b157d35aec06 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:50.522629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b0612-2e86-4ab8-9a63-b157d35aec06 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:50.523304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b0612-2e86-4ab8-9a63-b157d35aec06 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:50.523608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b0612-2e86-4ab8-9a63-b157d35aec06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:50.525012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b0612-2e86-4ab8-9a63-b157d35aec06 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:50.533594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 478/960] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:50.690289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721719c0-881a-491a-b1fe-3f565efc4b24 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:50.690926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721719c0-881a-491a-b1fe-3f565efc4b24 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:50.691426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721719c0-881a-491a-b1fe-3f565efc4b24 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:50.693310 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 483/961] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:50.698948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffb12-e41c-41e3-a36f-88b21732c71b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:50.699523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffb12-e41c-41e3-a36f-88b21732c71b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:50.700023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ffb12-e41c-41e3-a36f-88b21732c71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:50.718696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-464ffb12-e41c-41e3-a36f-88b21732c71b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:50.720728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-464ffb12-e41c-41e3-a36f-88b21732c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:50.792313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 479/962] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:51.057508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721719c0-881a-491a-b1fe-3f565efc4b24 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:51.117944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:51.160744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721719c0-881a-491a-b1fe-3f565efc4b24 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:51.199127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:51.199751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:51.200036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:51.200392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:51.201051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:51.202487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:51.250326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.sql.core [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 05:32:51.250326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 05:32:51.250326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [parameters: {'user_id': '97279e064b02454d82f5d984e747ece3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 05:32:51.250326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82146) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application conn.query(q) Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result.read() Aug 22 05:32:51.257444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 05:32:51.258386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application next(self.gen) Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application yield resource Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application next(self.gen) Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.session.rollback() Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.force_reraise() Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise self.value Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application session.commit() Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 22 05:32:51.259358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._prepare_impl() Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.session.flush() Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._flush(objects) Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application compat.raise_( Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application flush_context.execute() Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rec.execute(self) Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 22 05:32:51.260947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 22 05:32:51.263091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result = self._query(query) Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application conn.query(q) Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application result.read() Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 22 05:32:51.265444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [parameters: {'user_id': '97279e064b02454d82f5d984e747ece3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:51.267764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 22 05:32:51.270574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 22 05:32:51.277726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 22 05:32:51.277726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 22 05:32:51.277726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 22 05:32:51.277726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 22 05:32:51.277726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 22 05:32:51.277726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:51.277726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 484/963] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Aug 22 05:32:51 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:51.278180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffb12-e41c-41e3-a36f-88b21732c71b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:51.388672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ffb12-e41c-41e3-a36f-88b21732c71b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:51.390557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:51.426214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca29eb15-afa4-4b2c-b0c8-a5abfd67d41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:51.427135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29eb15-afa4-4b2c-b0c8-a5abfd67d41d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:51.427570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29eb15-afa4-4b2c-b0c8-a5abfd67d41d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:51.428057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca29eb15-afa4-4b2c-b0c8-a5abfd67d41d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:51.435806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29eb15-afa4-4b2c-b0c8-a5abfd67d41d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:51.437473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca29eb15-afa4-4b2c-b0c8-a5abfd67d41d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-ca29eb15-afa4-4b2c-b0c8-a5abfd67d41d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:51.450478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:51.451637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 22 05:32:51.452860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:51.459326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 480/964] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:32:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:51.462086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:51.565603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30d32e-532b-4527-98eb-ef5c7d9f6f3f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:51.586540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:51.601364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c4ed6-60e7-45bb-9337-8c215e452367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:51.603063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4ed6-60e7-45bb-9337-8c215e452367 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:51.603063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4ed6-60e7-45bb-9337-8c215e452367 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:51.603063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c4ed6-60e7-45bb-9337-8c215e452367 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:51.603308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c4ed6-60e7-45bb-9337-8c215e452367 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:51.603486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c4ed6-60e7-45bb-9337-8c215e452367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:51.605131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c4ed6-60e7-45bb-9337-8c215e452367 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:51.644341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 485/965] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Aug 22 05:32:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:51.745204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c286-8b6a-493b-a1e1-b388dcc787ab None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:51.745725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c286-8b6a-493b-a1e1-b388dcc787ab None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:51.746171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043c286-8b6a-493b-a1e1-b388dcc787ab None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:51.747919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 481/966] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:51.754039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3f2c-d003-4147-85f7-49a8dcb53482 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:51.754469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3f2c-d003-4147-85f7-49a8dcb53482 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:51.754847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3f2c-d003-4147-85f7-49a8dcb53482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:51.775294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3b3d3f2c-d003-4147-85f7-49a8dcb53482 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:51.776876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3b3d3f2c-d003-4147-85f7-49a8dcb53482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:51.778935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48e82c-55d0-4a53-ade7-a8967b6fc77a None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:51.779237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48e82c-55d0-4a53-ade7-a8967b6fc77a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:51.779515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48e82c-55d0-4a53-ade7-a8967b6fc77a None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:51.781050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 482/967] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:51.786671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2fdf5-77fd-42a5-b63d-2d195337004b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:51.786959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2fdf5-77fd-42a5-b63d-2d195337004b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:51.787242 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2fdf5-77fd-42a5-b63d-2d195337004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:51.807302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-eba2fdf5-77fd-42a5-b63d-2d195337004b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:51.809231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-eba2fdf5-77fd-42a5-b63d-2d195337004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:51.859737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 486/968] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:51.889968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 483/969] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:52.125856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3f2c-d003-4147-85f7-49a8dcb53482 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.163713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2fdf5-77fd-42a5-b63d-2d195337004b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.230398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3f2c-d003-4147-85f7-49a8dcb53482 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.240386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:52.263809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:52.266262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.266904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.267220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.267655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.268085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.269587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.274777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2fdf5-77fd-42a5-b63d-2d195337004b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:52.278472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:52.279456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:52.281279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 487/970] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:52.287662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.315495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.316146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.317208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.317208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.326843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:32:52.331545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:52.332686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:52.333662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 484/971] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:52.338755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.402472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bcdefc-24cd-458b-bfe7-a4c06b2c15fb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.436994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.437604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.437890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.438168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.438837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:52.439144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.440316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa72b4-1fdf-4c31-a4db-1b1326af3bee None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.440541 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.445469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 488/972] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:52.450864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.476683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.477286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.477592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.477863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.478519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:52.478827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.480225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.488414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:52.488886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 485/973] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:52.495211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.512698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:52.558410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032815bf-aa24-43d9-b777-92bca0a074e9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.591414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e7788-7196-423d-a627-07fba8e2a8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.592018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7788-7196-423d-a627-07fba8e2a8c3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.592331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7788-7196-423d-a627-07fba8e2a8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.592614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e7788-7196-423d-a627-07fba8e2a8c3 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.593248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7788-7196-423d-a627-07fba8e2a8c3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:52.593556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7788-7196-423d-a627-07fba8e2a8c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.594918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e7788-7196-423d-a627-07fba8e2a8c3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.596043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc5188-aab6-45a6-84d9-245ae04a8c7a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.600330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 489/974] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:52.601585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76169-f4ec-4206-98f2-261b3b69c18d None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.601982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76169-f4ec-4206-98f2-261b3b69c18d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.602365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d76169-f4ec-4206-98f2-261b3b69c18d None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.603697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 490/975] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:52.608471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76169-f4ec-4206-98f2-261b3b69c18d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.632341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3da68-1d4b-49b6-a0f3-004b3a329012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.633020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3da68-1d4b-49b6-a0f3-004b3a329012 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.633310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3da68-1d4b-49b6-a0f3-004b3a329012 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.633567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3da68-1d4b-49b6-a0f3-004b3a329012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.643659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3da68-1d4b-49b6-a0f3-004b3a329012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.645116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3da68-1d4b-49b6-a0f3-004b3a329012 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-82b3da68-1d4b-49b6-a0f3-004b3a329012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:52.659621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:52.660815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:52.661841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:52.661841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:52.661841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:52.661841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 486/976] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:52.662271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decba66-83ec-4c44-b0bd-8bac5a3ff21b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.662553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decba66-83ec-4c44-b0bd-8bac5a3ff21b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.662827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decba66-83ec-4c44-b0bd-8bac5a3ff21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.679706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2decba66-83ec-4c44-b0bd-8bac5a3ff21b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:52.680916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2decba66-83ec-4c44-b0bd-8bac5a3ff21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:52.708628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:52.712596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d76169-f4ec-4206-98f2-261b3b69c18d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.737917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:52.745468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 487/977] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:52.745624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.746232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.746349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decba66-83ec-4c44-b0bd-8bac5a3ff21b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.746514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.746792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.747501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] RBAC: Adding query filter params (interface=admin, service_id=dfa12126a5c34520abcf08d235acf68d, region_id=RegionOne) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:52.747814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.749216 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.758924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 491/978] 10.222.0.27 () {56 vars in 1249 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/endpoints?service_id=dfa12126a5c34520abcf08d235acf68d&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:52.759819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.846352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decba66-83ec-4c44-b0bd-8bac5a3ff21b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.864880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef03d4-9c3d-4698-9c2f-426f40046f1f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:52.879520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.880125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.880439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.880715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.881364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:52.881668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.883045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.894594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 488/979] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:52.900036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:52.907193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:52.907835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:52.908118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:52.908435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:52.909038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:52.910449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:52.916331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 492/980] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:32:52.962798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:53.010056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a786aad-3914-4efb-88f3-ac1116338779 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:53.015572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:53.046443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:53.046726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:53.047415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:53.047652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:53.047935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:53.056940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:53.058400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:32:53.070637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:53.071795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 22 05:32:53.073015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:53.075083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 489/981] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:32:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:53.081790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:53.134222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9602e-6b49-4de7-93ed-d0eb090cde1c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:53.173051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:53.174515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:53.174954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:53.175239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:53.175890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:53.177474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:53.187298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e0505-8d9b-43c1-9c6c-c19e49ea4bc2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:53.203742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:53.222058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:53.222653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:53.222935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:53.223215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:53.223940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:53.224276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:53.225704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:53.242476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 490/982] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Aug 22 05:32:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:53.248019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:53.254969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 493/983] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:53 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:32:53.365643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20159f84-e1e8-4146-b9ce-fff44db8a9e0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:53.409415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:53.410037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:53.410323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:53.410600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:53.451477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:53.479509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:53.481024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:53.583661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 491/984] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:32:53 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 05:32:53.585656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:53.672505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:53.685616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57642fba-919d-49f0-8756-9e1d21196488 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:53.719144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:53.719707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:53.720515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:53.720812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:53.732279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:53.733732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:32:53.749042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:53.749984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:32:53.756396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:32:53.756396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:32:53.756396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:53.756396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 494/985] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:53.758060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:53.826800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:53.857261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba100659-4604-4136-bf4a-1ca480b5de46 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:53.891245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:53.891876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:53.892911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:53.892999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:53.893616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:53.893922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:53.895287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:53.911092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 492/986] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:53.912799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:54.015453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f9667-f434-4e74-b6bf-e7ba57215e51 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:54.047887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:54.049053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:54.049334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:54.049609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:54.056010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:54.057464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:54.059875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:32:54.069692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:54.070648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:32:54.071574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:54.075493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 495/987] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:54.076923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:54.177943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fb2b-d79d-478b-b318-4c781ba3d9eb None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:54.205328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:54.211638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381a2e4-f6da-4eec-a225-63402affd1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:54.212329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a2e4-f6da-4eec-a225-63402affd1a1 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:54.212614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a2e4-f6da-4eec-a225-63402affd1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:54.212889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381a2e4-f6da-4eec-a225-63402affd1a1 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:54.216843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381a2e4-f6da-4eec-a225-63402affd1a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:54.216843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381a2e4-f6da-4eec-a225-63402affd1a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:54.216843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381a2e4-f6da-4eec-a225-63402affd1a1 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:54.232467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 493/988] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:32:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:54.234125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:54.344327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3124c0-fb5c-49e3-8f4c-212900dbc5c4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:54.380023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a3e8f-c243-482b-8c17-f20154e6a037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:54.380660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a3e8f-c243-482b-8c17-f20154e6a037 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:54.380941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a3e8f-c243-482b-8c17-f20154e6a037 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:54.381214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a3e8f-c243-482b-8c17-f20154e6a037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:54.381937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a3e8f-c243-482b-8c17-f20154e6a037 None admin] RBAC: Adding query filter params (role.id=0d86157ab7ad4f868971f9264e092bb0, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=2023824207074cc89a027c15b8425474) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:54.382261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a3e8f-c243-482b-8c17-f20154e6a037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:54.383683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a3e8f-c243-482b-8c17-f20154e6a037 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:54.396277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 496/989] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:32:54 2022] GET /identity/v3/role_assignments?user.id=2023824207074cc89a027c15b8425474&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0d86157ab7ad4f868971f9264e092bb0 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:54.823782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86390-3c97-459d-8ac1-fd3eca316bcc None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:54.824329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86390-3c97-459d-8ac1-fd3eca316bcc None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:54.824410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae86390-3c97-459d-8ac1-fd3eca316bcc None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:54.825858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 494/990] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:54.831403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a41519-c5c2-4f73-ae99-3947c831171e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:54.831822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a41519-c5c2-4f73-ae99-3947c831171e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:54.832000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a41519-c5c2-4f73-ae99-3947c831171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:54.851245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c8a41519-c5c2-4f73-ae99-3947c831171e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:54.852542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c8a41519-c5c2-4f73-ae99-3947c831171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:54.912716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:54.920937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 497/991] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:55.174837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb046-7629-4db5-a21b-0651da832384 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.175158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb046-7629-4db5-a21b-0651da832384 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.175392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb046-7629-4db5-a21b-0651da832384 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.176790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 495/992] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:55.181872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0cbba-4ee3-4ec8-89d1-4b7043c04ff7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.182173 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0cbba-4ee3-4ec8-89d1-4b7043c04ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.182463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0cbba-4ee3-4ec8-89d1-4b7043c04ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.183659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb046-7629-4db5-a21b-0651da832384 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:55.200775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f4e0cbba-4ee3-4ec8-89d1-4b7043c04ff7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:55.201970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f4e0cbba-4ee3-4ec8-89d1-4b7043c04ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:55.273702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 498/993] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:55.298968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb046-7629-4db5-a21b-0651da832384 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:55.334220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:55.334913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.335198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.335474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.336061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:55.337462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:55.346305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:55.347303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:55.348739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 496/994] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Aug 22 05:32:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:32:55.353393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0cbba-4ee3-4ec8-89d1-4b7043c04ff7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:55.454347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0cbba-4ee3-4ec8-89d1-4b7043c04ff7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:55.479342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:55.491020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:55.491633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.491919 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.492229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.493502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:55.493502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:55.494535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:55.502633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 499/995] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:55.506190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:55.541390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:55.566643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:55.624111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df92568-9228-4823-bbbc-68357ff0e1d0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:55.640580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a64800-de73-4115-946f-df211f7fbb80 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:55.660618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:55.661217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.661526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.661779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.662410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:55.662849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:55.664329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:55.669578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 497/996] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Aug 22 05:32:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:55.675669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:55.678333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:55.678965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.679246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.679519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.680103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:55.681480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:55.690812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:55.691830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:55.692814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 500/997] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:55.697628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:55.753086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:55.786328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9d32b-2ac8-4be9-9dfe-0e05c38b6abe None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:55.802716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22a50-9595-47b6-866b-df5bf4697382 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:55.804726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:55.822876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:55.823934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.824500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.824500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.825322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:55.826706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:55.838059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:55.838762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:55.839030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:55.839302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:55.839935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:55.840264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:55.841673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:55.846991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 501/998] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:55.852643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:55.905088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 498/999] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:32:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:32:55.966795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa53894-7f6d-4e2e-a1a3-81dc2a2c73f9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:55.984692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:56.011189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:56.011724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:56.012007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:56.012314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:56.012961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] RBAC: Adding query filter params (type=compute) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:56.013270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:56.014670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:56.026175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 502/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:56.027641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:56.133254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcba5f-7270-497e-8477-1dce38fbc18a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:56.167324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431be97-62ad-43c2-9630-685570496922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:56.167940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431be97-62ad-43c2-9630-685570496922 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:56.168401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431be97-62ad-43c2-9630-685570496922 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:56.168691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431be97-62ad-43c2-9630-685570496922 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:56.169411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431be97-62ad-43c2-9630-685570496922 None admin] RBAC: Adding query filter params (interface=public, service_id=a5cca41288c64946b1a20d675d917e4f, region_id=RegionOne) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:56.169728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431be97-62ad-43c2-9630-685570496922 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:56.171118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4431be97-62ad-43c2-9630-685570496922 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:56.177042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 499/1001] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:32:56 2022] GET /identity/v3/endpoints?service_id=a5cca41288c64946b1a20d675d917e4f&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:56.182514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:56.296801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa75ec-0a4f-4b92-9da2-04d1f78f471c None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:56.307350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69bbb-b8ed-4fb6-87dc-5a60a43bb878 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:56.307623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69bbb-b8ed-4fb6-87dc-5a60a43bb878 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:56.307900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec69bbb-b8ed-4fb6-87dc-5a60a43bb878 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:56.309431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 500/1002] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:32:56.314641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8da6db-c3bc-4ca3-b6f7-a68a9efdabb9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:56.314931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8da6db-c3bc-4ca3-b6f7-a68a9efdabb9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:56.315213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8da6db-c3bc-4ca3-b6f7-a68a9efdabb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:56.333600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:56.334035 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-bf8da6db-c3bc-4ca3-b6f7-a68a9efdabb9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:56.334468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:56.334755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:56.335031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:56.335128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-bf8da6db-c3bc-4ca3-b6f7-a68a9efdabb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:56.335646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:56.337039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:56.344040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 503/1003] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:32:56 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:32:56.373996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:56.412370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 501/1004] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:56.683750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:56.726310 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:56.784460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e7085-d817-44d1-8938-4661d71aaac4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:56.819364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:56.820342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:56.820852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:56.821343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] PATH_INFO: `/v3/services/image` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:56.822187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:56.823757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:56.832587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:56.833636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:32:56.834768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:32:56.840226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 504/1005] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Aug 22 05:32:56 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:56.843188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8da6db-c3bc-4ca3-b6f7-a68a9efdabb9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:56.944987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8da6db-c3bc-4ca3-b6f7-a68a9efdabb9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:56.979562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ede6c5-19ff-40e1-9bd3-07bdd1d7b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:56.980171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ede6c5-19ff-40e1-9bd3-07bdd1d7b063 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:56.980492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ede6c5-19ff-40e1-9bd3-07bdd1d7b063 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:56.980770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ede6c5-19ff-40e1-9bd3-07bdd1d7b063 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:56.981403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ede6c5-19ff-40e1-9bd3-07bdd1d7b063 None admin] RBAC: Adding query filter params (name=image) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:56.981710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ede6c5-19ff-40e1-9bd3-07bdd1d7b063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:56.983087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ede6c5-19ff-40e1-9bd3-07bdd1d7b063 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:56.988031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 502/1006] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:56.993552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:57.095859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6fb53-162b-4760-ac56-e90a67b65aeb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:57.098193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:57.128847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce1d0e-c48c-4f89-9204-d128bf52f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:57.129454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce1d0e-c48c-4f89-9204-d128bf52f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:57.129740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce1d0e-c48c-4f89-9204-d128bf52f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:57.130019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce1d0e-c48c-4f89-9204-d128bf52f2e2 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:57.130650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce1d0e-c48c-4f89-9204-d128bf52f2e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:57.131228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce1d0e-c48c-4f89-9204-d128bf52f2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:57.132930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce1d0e-c48c-4f89-9204-d128bf52f2e2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:57.137675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 505/1007] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:57.839288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26b6b1-dd86-4e28-b51c-7416cd06bca2 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:57.839693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26b6b1-dd86-4e28-b51c-7416cd06bca2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:57.839894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a26b6b1-dd86-4e28-b51c-7416cd06bca2 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:57.841359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 503/1008] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:57.847073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a5ed-996c-4267-86d7-554ef032b804 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:57.847551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a5ed-996c-4267-86d7-554ef032b804 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:57.847630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a5ed-996c-4267-86d7-554ef032b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:57.865632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b541a5ed-996c-4267-86d7-554ef032b804 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:57.866851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b541a5ed-996c-4267-86d7-554ef032b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:57.935017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 506/1009] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:58.202170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26b6b1-dd86-4e28-b51c-7416cd06bca2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:58.239599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:58.265954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b155667-1f0d-45c0-8052-aab0110fb2be None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:58.266452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b155667-1f0d-45c0-8052-aab0110fb2be None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:58.267536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b155667-1f0d-45c0-8052-aab0110fb2be None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:58.269006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 507/1010] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:32:58.274623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9229-df63-4660-96ee-6bba18509e14 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:58.274916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9229-df63-4660-96ee-6bba18509e14 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:58.275194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e9229-df63-4660-96ee-6bba18509e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:58.293423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-196e9229-df63-4660-96ee-6bba18509e14 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:58.294640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-196e9229-df63-4660-96ee-6bba18509e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:58.318454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a26b6b1-dd86-4e28-b51c-7416cd06bca2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:58.358484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:58.359029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:58.359313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:58.359590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:58.361308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:58.362752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:58.372537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 508/1011] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:58 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:32:58.372690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 504/1012] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:32:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:32:58.372787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e9229-df63-4660-96ee-6bba18509e14 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:58.397992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:58.471757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e9229-df63-4660-96ee-6bba18509e14 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:58.506274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:58.506883 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:58.507194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:58.507438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:58.508083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:58.509545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:58.591428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 509/1013] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:58 2022] POST /identity/v3/projects => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:32:58.638000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:58.751096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820981a6-d68c-435a-9929-cde22eecf144 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:58.754153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:58.789127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:58.789761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:58.790039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:58.790314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:58.790904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:58.792343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:32:58.801226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:32:58.802428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:32:58.803423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 505/1014] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:32:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:32:58.808671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:58.891193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:58.910619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62098-9879-4584-9e8a-9e9c16d9c15a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:58.944554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85431a61-6103-448f-a98e-2be9bc317fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:58.945174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431a61-6103-448f-a98e-2be9bc317fbb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:58.945457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431a61-6103-448f-a98e-2be9bc317fbb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:58.945732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85431a61-6103-448f-a98e-2be9bc317fbb None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:58.946371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431a61-6103-448f-a98e-2be9bc317fbb None admin] RBAC: Adding query filter params (name=compute) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:58.946679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431a61-6103-448f-a98e-2be9bc317fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:58.948097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85431a61-6103-448f-a98e-2be9bc317fbb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:58.959341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 510/1015] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:58.961023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:59.025521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf0db-ae56-438e-b40c-f4d04228703e None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:59.025816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf0db-ae56-438e-b40c-f4d04228703e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:59.026008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cf0db-ae56-438e-b40c-f4d04228703e None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:59.027486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 511/1016] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:32:59.032111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12174db-0272-4d26-8cac-019c723c92f2 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:59.032466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12174db-0272-4d26-8cac-019c723c92f2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:59.032750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12174db-0272-4d26-8cac-019c723c92f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:59.050279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f12174db-0272-4d26-8cac-019c723c92f2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:32:59.051466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f12174db-0272-4d26-8cac-019c723c92f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:32:59.077229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314b4b6-18aa-4c69-aea2-af1f4c0d8ac8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:59.114454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:59.115478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:59.115933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:59.116053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:59.116682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:32:59.116990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:59.118359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:59.120492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 512/1017] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:32:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:32:59.128279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 506/1018] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Aug 22 05:32:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:32:59.130254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12174db-0272-4d26-8cac-019c723c92f2 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:59.205705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:59.230042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12174db-0272-4d26-8cac-019c723c92f2 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:59.263779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481ae91-6508-4c3f-84ce-5b3cb28a59ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:59.264413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ae91-6508-4c3f-84ce-5b3cb28a59ef None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:59.264694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ae91-6508-4c3f-84ce-5b3cb28a59ef None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:59.264966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ae91-6508-4c3f-84ce-5b3cb28a59ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:59.265626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481ae91-6508-4c3f-84ce-5b3cb28a59ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:59.267542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481ae91-6508-4c3f-84ce-5b3cb28a59ef None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:59.378982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 513/1019] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:32:59 2022] POST /identity/v3/endpoints => generated 334 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:32:59.391429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:32:59.428045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:32:59.502387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8bbdf-354d-41cd-8c94-2354a122c740 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:32:59.546405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00f951-7901-46c6-ac93-23006291148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:32:59.547008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00f951-7901-46c6-ac93-23006291148b None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:32:59.547307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00f951-7901-46c6-ac93-23006291148b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:32:59.547566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00f951-7901-46c6-ac93-23006291148b None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:32:59.548336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00f951-7901-46c6-ac93-23006291148b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:32:59.549631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00f951-7901-46c6-ac93-23006291148b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:32:59.631358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 507/1020] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:32:59 2022] POST /identity/v3/services => generated 242 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:33:00.564719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38075b1b-0ee2-4776-90d3-7cd71fd0082c None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:00.565245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38075b1b-0ee2-4776-90d3-7cd71fd0082c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:00.565334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38075b1b-0ee2-4776-90d3-7cd71fd0082c None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:00.566939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 514/1021] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:00.572713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3aed6-adc5-4e0e-8075-a42381b0d1a4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:00.573227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3aed6-adc5-4e0e-8075-a42381b0d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:00.573302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3aed6-adc5-4e0e-8075-a42381b0d1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:00.591462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-87c3aed6-adc5-4e0e-8075-a42381b0d1a4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:00.592677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-87c3aed6-adc5-4e0e-8075-a42381b0d1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:00.668301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 508/1022] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:00.943256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38075b1b-0ee2-4776-90d3-7cd71fd0082c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:01.048661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38075b1b-0ee2-4776-90d3-7cd71fd0082c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:01.077428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:01.084672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf0be3-643b-42b9-be7f-dbf439ad8a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:01.085315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf0be3-643b-42b9-be7f-dbf439ad8a57 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:01.085601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf0be3-643b-42b9-be7f-dbf439ad8a57 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:01.085878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf0be3-643b-42b9-be7f-dbf439ad8a57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:01.087005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf0be3-643b-42b9-be7f-dbf439ad8a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:01.088496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf0be3-643b-42b9-be7f-dbf439ad8a57 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:01.103500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 515/1023] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:01.103639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3aed6-adc5-4e0e-8075-a42381b0d1a4 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:01.110869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:01.195988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3aed6-adc5-4e0e-8075-a42381b0d1a4 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:01.231140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841025bc-284d-4fba-a66c-9e1524c9a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:01.231763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841025bc-284d-4fba-a66c-9e1524c9a939 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:01.232048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841025bc-284d-4fba-a66c-9e1524c9a939 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:01.232360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841025bc-284d-4fba-a66c-9e1524c9a939 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:01.233031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841025bc-284d-4fba-a66c-9e1524c9a939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:01.234476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841025bc-284d-4fba-a66c-9e1524c9a939 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:01.373254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 509/1024] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:33:01 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:33:01.395026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55305db-c45e-41b2-bc5e-50175aa34add None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:01.395343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55305db-c45e-41b2-bc5e-50175aa34add None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:01.395593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55305db-c45e-41b2-bc5e-50175aa34add None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:01.397214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 516/1025] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:01.403130 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c291-c7ed-436d-8b73-ba676b10d321 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:01.403426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c291-c7ed-436d-8b73-ba676b10d321 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:01.403688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2c291-c7ed-436d-8b73-ba676b10d321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:01.422222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-21f2c291-c7ed-436d-8b73-ba676b10d321 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:01.423972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-21f2c291-c7ed-436d-8b73-ba676b10d321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:01.492259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:01.497875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 510/1026] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:01.545094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb94e2-7b29-47ca-a8f2-2deb4254dc29 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:01.545425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb94e2-7b29-47ca-a8f2-2deb4254dc29 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:01.545659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb94e2-7b29-47ca-a8f2-2deb4254dc29 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:01.547127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 517/1027] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:01.552710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962137-39b5-439c-9e33-12857a90f982 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:01.553006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962137-39b5-439c-9e33-12857a90f982 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:01.553284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5962137-39b5-439c-9e33-12857a90f982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:01.572109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b5962137-39b5-439c-9e33-12857a90f982 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:01.573319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b5962137-39b5-439c-9e33-12857a90f982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:01.641942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 511/1028] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:01.767169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb94e2-7b29-47ca-a8f2-2deb4254dc29 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:01.871657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb94e2-7b29-47ca-a8f2-2deb4254dc29 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:01.906661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:01.907317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:01.907597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:01.907872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:01.913891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962137-39b5-439c-9e33-12857a90f982 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:01.920924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:01.925600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:01.926558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:01.927428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 518/1029] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Aug 22 05:33:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:01.932552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:01.998244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.019394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5962137-39b5-439c-9e33-12857a90f982 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.042869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2af06-6716-4174-b645-f954667ebda8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.047308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.053308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.054304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.054584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.054859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] PATH_INFO: `/v3/services/image` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.055767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.057328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:02.067520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:02.069002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:02.069986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 512/1030] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Aug 22 05:33:01 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:02.074605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.085066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.085704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.085994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.086277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.087374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:02.087688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.089720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.098687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 519/1031] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Aug 22 05:33:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:02.104010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.180135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac487f1-8082-434f-acb5-ea46be602e82 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.216103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.216733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.216846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a406d-8840-43ab-980c-1219cb986cc0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.217018 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.217294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.217927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] RBAC: Adding query filter params (name=image) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:02.218245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.219657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.224819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 513/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:02.230176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.242335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.257294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.258040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.258329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.258635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.269742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.271262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:02.286133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:02.292255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:33:02.293479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:02.293479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:02.293479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:02.293479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 520/1033] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:02.293479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.300762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.344297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70e281-f707-49f2-97de-ce6e8bbc0361 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.379553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.380224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.380523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.380803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.381447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] RBAC: Adding query filter params (type=image) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:02.381763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.383424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.389132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 514/1034] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:02.394860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.399829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fabd71-af0f-43ba-ae85-6136937d1d30 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.436066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.436813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.437097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.437376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.438018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:02.438872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.440366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.457326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 521/1035] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:02.458370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.489896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.517060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c77b3a-c1be-4e3b-9a4b-a4e309ea1b86 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.542440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.554682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.555319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.555567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.555850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.556583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] RBAC: Adding query filter params (interface=public, service_id=b6e8ddbf51a54812b02411785e84fdf4, region_id=RegionOne) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:02.556897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.558277 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.563723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 515/1036] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/endpoints?service_id=b6e8ddbf51a54812b02411785e84fdf4&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:02.565471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e945568-5812-4150-a4a5-81d47c11627f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.569224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.604457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.605090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.605379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.605696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.614035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.615476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:33:02.627952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:02.628978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:02.629953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 522/1037] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:02.634695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.681347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48d51-38a6-452a-b05b-792ac82efd7c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.721799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.722873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.723378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.724228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.725113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.726697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.732922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.748237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 516/1038] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:33:02.748450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1c9be-d847-4a99-9dae-4a3e36636446 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.781240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.782445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.782679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.782973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:02.783728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:02.784044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:02.785571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:02.806276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 523/1039] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:02.811876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:02.867885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:02.926223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93cf98b-5460-4656-ba86-6ef709360202 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:02.959901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:02.960536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:02.960823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:02.961099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.027667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:03.029155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:03.076538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:03.129045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 517/1040] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 05:33:03.134619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:03.236231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5255c61-992b-4b5f-a0be-d4a62cc76bc6 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:03.270819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bac261-f8a4-4329-86fb-d0c2dec97ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:03.271452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bac261-f8a4-4329-86fb-d0c2dec97ace None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.271737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bac261-f8a4-4329-86fb-d0c2dec97ace None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.272016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bac261-f8a4-4329-86fb-d0c2dec97ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.282802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bac261-f8a4-4329-86fb-d0c2dec97ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:03.284668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bac261-f8a4-4329-86fb-d0c2dec97ace None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-a2bac261-f8a4-4329-86fb-d0c2dec97ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:03.301824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:03.302984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:33:03.304185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:03.304185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:03.304185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:03.308353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 524/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:03.310112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:03.349254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0be3e-069a-45f4-9924-05b65a38387f None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.349447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0be3e-069a-45f4-9924-05b65a38387f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.349733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0be3e-069a-45f4-9924-05b65a38387f None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.351237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 525/1042] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:33:03.356306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9fb0-f3c2-43e9-ad70-692a02d3cf14 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.356604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9fb0-f3c2-43e9-ad70-692a02d3cf14 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.356886 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f9fb0-f3c2-43e9-ad70-692a02d3cf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.363314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:03.375417 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b10f9fb0-f3c2-43e9-ad70-692a02d3cf14 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:03.377226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b10f9fb0-f3c2-43e9-ad70-692a02d3cf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:03.417255 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be4c136-a489-444c-b2b2-c334ca600ee8 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:03.445725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 526/1043] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:33:03.455618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:03.456254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.456542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.456817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.457463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:03.457770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:03.459402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:03.471168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 518/1044] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:03.476949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9fb0-f3c2-43e9-ad70-692a02d3cf14 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:03.574406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f9fb0-f3c2-43e9-ad70-692a02d3cf14 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:03.603770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:03.609454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:03.610693 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.610978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.611252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.617786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:03.622467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:33:03.630802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:03.631768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:33:03.633010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:03.636497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 527/1045] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:33:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:03.637727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:03.651705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:03.714341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:03.743925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510459fc-042e-4993-a7be-e26c0f1499eb None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:03.780820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:03.781429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.781710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.782606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.783299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:03.783610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:03.785075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:03.796907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 519/1046] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:33:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:03.803437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:03.829947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ef3ac-2759-4fb8-9c82-822fe755f59f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:03.868066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:03.868654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.868934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.869205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.879581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:03.880658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:03.885280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:03.886249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:03.887124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 528/1047] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:03.892948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:03.915041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b8f8-9c1c-4fbe-a8d9-d0e495475fe5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:03.945736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:03.953344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:03.954476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:03.954760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:03.955036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:03.955762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] RBAC: Adding query filter params (role.id=0d86157ab7ad4f868971f9264e092bb0, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=344aa2356f0c4d8fb88e7c35603a65c0) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:03.956080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:03.957544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:03.972618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 520/1048] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:03 2022] GET /identity/v3/role_assignments?user.id=344aa2356f0c4d8fb88e7c35603a65c0&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0d86157ab7ad4f868971f9264e092bb0 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:03.997072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584f011-a744-4f15-b087-e7f89b2bf1e8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:04.034050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:04.034665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:04.034946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:04.035222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:04.035912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:04.036247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:04.037649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:04.051802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 529/1049] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:04.053431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:04.160670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a370bf7-e39a-4873-b197-47eb1bb94f8d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:04.193699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:04.194330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:04.194613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:04.194889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] PATH_INFO: `/v3/users/7f7e7738ac164818b63056e154fb97e0` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:04.196793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:04.210008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] RBAC: Authorizing `identity:get_user(user_id=7f7e7738ac164818b63056e154fb97e0)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:04.211526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:04.213419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 521/1050] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:04 2022] GET /identity/v3/users/7f7e7738ac164818b63056e154fb97e0 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:04.219052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:04.325806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9559d-6fdf-4f27-8bfd-4b3be03e82d4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:04.340656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:04.360889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a5e9a-26cb-4f17-9610-cc5eea43cc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:04.361753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5e9a-26cb-4f17-9610-cc5eea43cc69 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:04.362051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5e9a-26cb-4f17-9610-cc5eea43cc69 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:04.362328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5e9a-26cb-4f17-9610-cc5eea43cc69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:04.431703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a5e9a-26cb-4f17-9610-cc5eea43cc69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:04.433102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a5e9a-26cb-4f17-9610-cc5eea43cc69 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:04.530326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 530/1051] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:04.535949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:04.636252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e950c09-43eb-403a-8d71-8021bbeb3953 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:04.667805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abaf66-0147-454e-ac66-12930928ae06 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:04.668096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abaf66-0147-454e-ac66-12930928ae06 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:04.668412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abaf66-0147-454e-ac66-12930928ae06 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:04.668978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:04.669604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:04.669996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 531/1052] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:33:04.670113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:04.670198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:04.671261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] RBAC: Authorizing `identity:get_project(project_id=6c2059ea30a242bbbfda4fda1f48722a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:04.673245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:04.674968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 522/1053] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:04 2022] GET /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:04.675466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf24a7-5797-451f-ae4e-c22da007d06b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:04.675767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf24a7-5797-451f-ae4e-c22da007d06b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:04.676239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaf24a7-5797-451f-ae4e-c22da007d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:04.680727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:04.700115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-faaf24a7-5797-451f-ae4e-c22da007d06b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:04.701680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-faaf24a7-5797-451f-ae4e-c22da007d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:04.715237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:04.742820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:04.784241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 532/1054] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:04.787371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eba33d-f547-4f4e-84df-9747271dada1 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:04.823022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:04.823630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:04.823914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:04.824203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:04.824953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=6c2059ea30a242bbbfda4fda1f48722a, user.id=7f7e7738ac164818b63056e154fb97e0) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:04.825269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:04.826752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:04.832458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 523/1055] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:04 2022] GET /identity/v3/role_assignments?user.id=7f7e7738ac164818b63056e154fb97e0&scope.project.id=6c2059ea30a242bbbfda4fda1f48722a&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:05.054299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf24a7-5797-451f-ae4e-c22da007d06b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:05.154183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaf24a7-5797-451f-ae4e-c22da007d06b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:05.187325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:05.187975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:05.188803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:05.189081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] PATH_INFO: `/v3/services/image` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:05.189666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:05.191057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:05.199565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:05.200593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 22 05:33:05.201459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:05.202823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 533/1056] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Aug 22 05:33:05 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:05.207021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:05.315940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89bada3-2c14-45c3-9d91-30af0a194857 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:05.339231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:05.350821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:05.355298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:05.355298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:05.355298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:05.355298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] RBAC: Adding query filter params (name=image) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:05.355298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:05.355298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:05.359654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 524/1057] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:05.365540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:05.376838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:05.466493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b101-05b3-48b5-8219-922875ba8ed5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:05.499839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86710d48-72f4-4896-9299-92ba1d88c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:05.500491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86710d48-72f4-4896-9299-92ba1d88c36d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:05.500779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86710d48-72f4-4896-9299-92ba1d88c36d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:05.501053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86710d48-72f4-4896-9299-92ba1d88c36d None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:05.501681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86710d48-72f4-4896-9299-92ba1d88c36d None admin] RBAC: Adding query filter params (type=image) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:05.501988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86710d48-72f4-4896-9299-92ba1d88c36d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:05.503352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86710d48-72f4-4896-9299-92ba1d88c36d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:05.508250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 534/1058] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:05.513733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:05.616681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced76dd-0f20-4c5e-a3ce-bb5a39bd1c50 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:05.650385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6db7ed-ec55-463a-93df-b563879a454f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:05.650993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db7ed-ec55-463a-93df-b563879a454f None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:05.651277 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db7ed-ec55-463a-93df-b563879a454f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:05.651553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db7ed-ec55-463a-93df-b563879a454f None admin] PATH_INFO: `/v3/endpoints` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:05.652315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6db7ed-ec55-463a-93df-b563879a454f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:05.653793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6db7ed-ec55-463a-93df-b563879a454f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:05.733082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 525/1059] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:33:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:33:05.857493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdb318-98c5-446a-b8ce-92913c1e0394 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:05.857860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdb318-98c5-446a-b8ce-92913c1e0394 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:05.858073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdb318-98c5-446a-b8ce-92913c1e0394 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:05.859620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 535/1060] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:05.865182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca385c-da81-46d2-9d79-e13729522e6a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:05.865687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca385c-da81-46d2-9d79-e13729522e6a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:05.865783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca385c-da81-46d2-9d79-e13729522e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:05.886156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-6eca385c-da81-46d2-9d79-e13729522e6a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:05.887327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6eca385c-da81-46d2-9d79-e13729522e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:05.931393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:05.963615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 526/1061] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:06.238811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdb318-98c5-446a-b8ce-92913c1e0394 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:06.317067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:06.347387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdb318-98c5-446a-b8ce-92913c1e0394 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:06.383154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:06.383796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:06.384082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:06.384384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:06.395345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:06.400088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:06.401049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:06.401902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 536/1062] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Aug 22 05:33:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:06.409158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca385c-da81-46d2-9d79-e13729522e6a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:06.508907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca385c-da81-46d2-9d79-e13729522e6a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:06.542212 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a2560-fca3-49df-b348-540e822988d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:06.542825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2560-fca3-49df-b348-540e822988d5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:06.543108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2560-fca3-49df-b348-540e822988d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:06.543387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a2560-fca3-49df-b348-540e822988d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:06.544054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a2560-fca3-49df-b348-540e822988d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:06.544637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a2560-fca3-49df-b348-540e822988d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:06.546032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a2560-fca3-49df-b348-540e822988d5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:06.559469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 527/1063] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Aug 22 05:33:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:06.560799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:06.663927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b533f-374b-4c73-8664-5c208219e972 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:06.692686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:06.697943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:06.698577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:06.698860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:06.699139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:06.708421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47890ce-1905-40bc-80aa-1991fe6f42bf None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:06.708979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47890ce-1905-40bc-80aa-1991fe6f42bf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:06.721747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47890ce-1905-40bc-80aa-1991fe6f42bf None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:06.721747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 528/1064] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:33:06.721932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:06.721932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:06.722068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d19e-768c-4fff-9d52-16c8c4a738ed None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:06.722068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d19e-768c-4fff-9d52-16c8c4a738ed None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:06.722068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213d19e-768c-4fff-9d52-16c8c4a738ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:06.729297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:06.730296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:33:06.732575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:06.732575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:06.732575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:06.732575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 537/1065] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:06.735996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:06.737122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e213d19e-768c-4fff-9d52-16c8c4a738ed None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:06.738333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e213d19e-768c-4fff-9d52-16c8c4a738ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:06.767322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:06.811921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 529/1066] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:33:06.843530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a519fd-59e9-43c8-b881-ec4ee9745d7b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:06.877983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:06.878591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:06.878877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:06.879153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:06.879800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:06.880108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:06.881533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:06.893994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 538/1067] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:06.899608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d19e-768c-4fff-9d52-16c8c4a738ed None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:06.997654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213d19e-768c-4fff-9d52-16c8c4a738ed None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.030799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.031367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.032167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.032476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.039256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.040739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:33:07.053044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:07.054011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:33:07.054985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:07.056492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 530/1068] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:33:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:07.059935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.081662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.107010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.108724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.161364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46664c7b-9f28-4b9a-80e9-6243879f7aa5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.192008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662dcf1-209d-4b43-86de-173ac54f5cd6 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.197290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.197904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.198188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.198467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.199199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:07.199718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.200958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.220100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 539/1069] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:07.225870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.232368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.237624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.237624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.237624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.244904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:07.249590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:07.250593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:07.251470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:07.255801 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 531/1070] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:07.256629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.335321 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06bdc1-9bc9-4ab6-a600-57d7588fde84 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.337389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.372480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.373122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.373408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.373688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.384135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.385610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:07.400638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:07.404338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:33:07.405491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:07.405491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:07.405491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:07.405491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 540/1071] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:07.408003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.419342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.439434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d832a-d47f-4d8f-8479-0c43873148b2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.481326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.482034 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.482427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.482711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.483387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:07.483700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.485141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.493630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 532/1072] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:07.499225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.513017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6600-472b-467d-a154-4e9a0ccecb91 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.550245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.550779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.551069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.551357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.551995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:07.552343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.553721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.566027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 541/1073] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:07.571514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.587223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.605100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90326e96-2dda-4998-b1ef-aa18ac73c830 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.639334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.639961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.640378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.640676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] PATH_INFO: `/v3/users/7f7e7738ac164818b63056e154fb97e0` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.642415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] RBAC: Authorizing `identity:get_user(user_id=7f7e7738ac164818b63056e154fb97e0)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.643855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.645630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 533/1074] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/users/7f7e7738ac164818b63056e154fb97e0 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:07.651020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.666361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.673332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b5a365-237b-4054-b622-f6e94aa651f6 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.706849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e867f-43bd-4584-98d3-b14fed58745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.707476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e867f-43bd-4584-98d3-b14fed58745f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.707755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e867f-43bd-4584-98d3-b14fed58745f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.708025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e867f-43bd-4584-98d3-b14fed58745f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.714774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e867f-43bd-4584-98d3-b14fed58745f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.716244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e867f-43bd-4584-98d3-b14fed58745f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-1a5e867f-43bd-4584-98d3-b14fed58745f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:33:07.727521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:07.728594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:07.729515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 542/1075] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:07.730065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65dfbc-6c88-4857-a2cb-25e8179fe8d9 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.730407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65dfbc-6c88-4857-a2cb-25e8179fe8d9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.730691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65dfbc-6c88-4857-a2cb-25e8179fe8d9 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.732029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 543/1076] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:07.734436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65dfbc-6c88-4857-a2cb-25e8179fe8d9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.755421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9630c7-cd15-48ff-b493-7a75d65f990b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.789389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804253d-a0ef-4c63-9864-27b0bf73c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.790014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804253d-a0ef-4c63-9864-27b0bf73c466 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.790296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804253d-a0ef-4c63-9864-27b0bf73c466 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.790574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804253d-a0ef-4c63-9864-27b0bf73c466 None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.791683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804253d-a0ef-4c63-9864-27b0bf73c466 None admin] RBAC: Authorizing `identity:get_project(project_id=6c2059ea30a242bbbfda4fda1f48722a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.793156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804253d-a0ef-4c63-9864-27b0bf73c466 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.794771 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 534/1077] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:07.796297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b82a0-11c7-435c-9df0-2050cde636dd None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.796519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b82a0-11c7-435c-9df0-2050cde636dd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.796797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b82a0-11c7-435c-9df0-2050cde636dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.813381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.815197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2a2b82a0-11c7-435c-9df0-2050cde636dd None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:07.816424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2a2b82a0-11c7-435c-9df0-2050cde636dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:07.838817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65dfbc-6c88-4857-a2cb-25e8179fe8d9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:07.871937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:07.872569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:07.872856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:07.873133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:07.873823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:07.874131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:07.876082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:07.881999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 535/1078] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:07.882793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b82a0-11c7-435c-9df0-2050cde636dd None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.892694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 544/1079] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:33:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:07.896545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:07.899275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:07.993719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b82a0-11c7-435c-9df0-2050cde636dd None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:08.003308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ffa04-04cd-4aa9-a1cf-b19e441f77eb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:08.037428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:08.037811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:08.038249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:08.038473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:08.038620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:08.038768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:08.039052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/344aa2356f0c4d8fb88e7c35603a65c0/roles/0d86157ab7ad4f868971f9264e092bb0` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:08.039161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a/users/7f7e7738ac164818b63056e154fb97e0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:08.041044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c2059ea30a242bbbfda4fda1f48722a, user_id=7f7e7738ac164818b63056e154fb97e0, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:08.041234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=344aa2356f0c4d8fb88e7c35603a65c0, role_id=0d86157ab7ad4f868971f9264e092bb0)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:08.042480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:08.042663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:08.044946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:08.114679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 536/1080] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:33:07 2022] PUT /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a/users/7f7e7738ac164818b63056e154fb97e0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:33:08.117306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 545/1081] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:33:07 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/344aa2356f0c4d8fb88e7c35603a65c0/roles/0d86157ab7ad4f868971f9264e092bb0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:33:08.150490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:08.231258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:08.268456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858349e-2ab7-4246-9e19-72c18ca00536 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:08.309047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:08.309658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:08.309936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:08.310208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:08.376954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:08.378323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:08.443756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:08.474887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 537/1082] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:08.481209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:08.580820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d540d5b-2a46-41d9-8f6a-865542a35643 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:08.616995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ea9f6-0037-4c65-a67f-ffab5a85973c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:08.617629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea9f6-0037-4c65-a67f-ffab5a85973c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:08.617909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea9f6-0037-4c65-a67f-ffab5a85973c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:08.618186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea9f6-0037-4c65-a67f-ffab5a85973c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:08.628655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ea9f6-0037-4c65-a67f-ffab5a85973c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:08.630030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6ea9f6-0037-4c65-a67f-ffab5a85973c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-cc6ea9f6-0037-4c65-a67f-ffab5a85973c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:08.644924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:08.645926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:33:08.646831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:08.646831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:08.646831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:08.646831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 546/1083] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:08.651830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:08.749298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec837408-3c71-47ac-ad43-d1b48a644b7c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:08.783209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529cb1f-827a-440e-b741-2e62f649235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:08.783817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529cb1f-827a-440e-b741-2e62f649235b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:08.784099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529cb1f-827a-440e-b741-2e62f649235b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:08.784403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529cb1f-827a-440e-b741-2e62f649235b None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:08.785047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529cb1f-827a-440e-b741-2e62f649235b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:08.785352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529cb1f-827a-440e-b741-2e62f649235b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:08.786718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529cb1f-827a-440e-b741-2e62f649235b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:08.804220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 538/1084] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:10.054695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790380-8161-4e7f-b734-96f155b1d362 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.055272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573173-4f3e-42bd-9e3e-4cf6738968fd None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.055272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573173-4f3e-42bd-9e3e-4cf6738968fd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.055721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790380-8161-4e7f-b734-96f155b1d362 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.055809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1573173-4f3e-42bd-9e3e-4cf6738968fd None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.055892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7790380-8161-4e7f-b734-96f155b1d362 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.056645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 547/1086] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:10.056846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 539/1086] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:10.061466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07255-77d6-47a3-926f-60914e0c0b3f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.061752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07255-77d6-47a3-926f-60914e0c0b3f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.061945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef14374-7ae2-423f-bf70-97612b6bdb4f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.062040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b07255-77d6-47a3-926f-60914e0c0b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.062238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef14374-7ae2-423f-bf70-97612b6bdb4f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.062520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef14374-7ae2-423f-bf70-97612b6bdb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.080808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-21b07255-77d6-47a3-926f-60914e0c0b3f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:10.081007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-eef14374-7ae2-423f-bf70-97612b6bdb4f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:10.082035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-21b07255-77d6-47a3-926f-60914e0c0b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:10.082147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-eef14374-7ae2-423f-bf70-97612b6bdb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:10.105361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:10.123089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:10.148174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 548/1087] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:10.149345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 540/1088] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:33:10.415442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b07255-77d6-47a3-926f-60914e0c0b3f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.425304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef14374-7ae2-423f-bf70-97612b6bdb4f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.515806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b07255-77d6-47a3-926f-60914e0c0b3f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:10.522401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef14374-7ae2-423f-bf70-97612b6bdb4f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:10.552381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:10.553018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.553303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.553580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.556133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:10.556614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.556897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.557172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.563899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:10.567565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:10.568692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:10.569866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:10.570938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 549/1089] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:10.574932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:10.576032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 22 05:33:10.576970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:10.577609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.577700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 541/1090] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:10.581892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.603096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:10.611135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:10.675407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cb3b8-9a14-4211-9971-49fd10652e57 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:10.679703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb922-a89a-469b-bb03-8b9801966dd0 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:10.710125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:10.710728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.711014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.711294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.711967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:10.712307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:10.713402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:10.713675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:10.713990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.714270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.714542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.715199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:10.715504 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:10.716879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:10.721756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 550/1091] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:10.724911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 542/1092] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:10.727209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.730328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.812512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:10.824874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:10.828611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed881b5-e668-4553-85fb-60a7af6c0c45 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:10.829922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778c029-f198-4771-8f09-0768b3c5dc4f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:10.862384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:10.863011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.863298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.863581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] PATH_INFO: `/v3/users/7f7e7738ac164818b63056e154fb97e0` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.864422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:10.864742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] RBAC: Authorizing `identity:get_user(user_id=7f7e7738ac164818b63056e154fb97e0)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:10.865046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:10.865352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:10.865636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:10.866350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:10.868079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 551/1093] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/users/7f7e7738ac164818b63056e154fb97e0 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:10.873794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.880153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:10.881625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:10.895788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:10.896948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:33:10.898060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:10.898060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:10.898060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:10.898060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 543/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:10.902673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:10.972544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb45205-40c0-4fac-85eb-56d5274214e3 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:10.999003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fc279-5cbf-41ce-b149-fa10d3232141 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:11.007303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.008007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.008390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.008734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.031978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.032593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.032877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.033144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.033776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:11.034078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.035424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.036813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:11.042536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:11.048543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 544/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:11.054084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:11.076023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.077510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.149871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727757d3-6383-4e6c-a250-0496b9dd38e5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:11.176961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 552/1096] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 05:33:11.182834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:11.186537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.187161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.187441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.188373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] PATH_INFO: `/v3/users/nova` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.195774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.197233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:33:11.209153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:11.210107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:11.211955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 545/1097] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Aug 22 05:33:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:33:11.215801 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:11.249433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:11.270629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:11.282975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65aba6-7de1-4e1f-92e0-41b8d1ee0f25 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:11.342412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322b929-ff45-4ddb-a50a-3885a1ee967e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:11.344648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.345286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.345567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.345843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.346966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] RBAC: Authorizing `identity:get_project(project_id=6c2059ea30a242bbbfda4fda1f48722a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.348431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.350062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 553/1098] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:11 2022] GET /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:11.355972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:11.376690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.377292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.377572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.381619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.381619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:11.381619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.381619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.397892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 546/1099] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Aug 22 05:33:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:11.403505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:11.455516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1435-cb70-44b0-ab6e-33529a55af9e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:11.488988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.489590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.489895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.490158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.490911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=6c2059ea30a242bbbfda4fda1f48722a, user.id=7f7e7738ac164818b63056e154fb97e0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:11.491228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.492692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.494549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:11.498854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 554/1100] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:11 2022] GET /identity/v3/role_assignments?user.id=7f7e7738ac164818b63056e154fb97e0&scope.project.id=6c2059ea30a242bbbfda4fda1f48722a&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:11.502602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d630737-d9e8-4ca3-8fcc-b457b15cc174 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:11.517197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:11.540621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.541254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.541542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.541823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.613211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.614678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.712263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 547/1101] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 05:33:11.718060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:11.816019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a0b2-12a4-426f-b0ae-15c81d5a6084 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:11.849008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:11.849643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:11.849930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:11.850209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:11.861045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:11.862490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:11.876071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:11.877054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:33:11.878053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:11.878053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:33:11.878053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:11.878053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 555/1102] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:11.882929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:11.899741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:11.984357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4ff16-693c-4369-ae75-ab1ab4e885c4 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:12.017385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:12.017983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:12.018266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:12.018545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:12.019185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:12.019492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:12.020901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:12.032428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 548/1103] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:12.037988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:12.086389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:12.134905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10a698-2318-4934-816d-c1a043abbf7a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:12.168089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:12.168747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:12.169034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:12.169314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:12.175773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:12.177239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:33:12.188096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:12.189196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:12.190129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 556/1104] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:12.195014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:12.262948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:12.297692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8872c8-b57d-4ef1-a156-7c84f65e5905 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:12.330905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe7dc7-3122-4d7e-bf19-547c310ec93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:12.331505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7dc7-3122-4d7e-bf19-547c310ec93e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:12.331789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7dc7-3122-4d7e-bf19-547c310ec93e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:12.332070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe7dc7-3122-4d7e-bf19-547c310ec93e None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:12.332805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe7dc7-3122-4d7e-bf19-547c310ec93e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:12.333118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe7dc7-3122-4d7e-bf19-547c310ec93e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:12.334837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe7dc7-3122-4d7e-bf19-547c310ec93e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:12.346475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 549/1105] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:12.352401 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:12.450189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc25eb-027c-445d-88b1-3983a56034b2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:12.461099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:12.484063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f8214f-2bb1-4d74-9f17-6df83ab633d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:12.485291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8214f-2bb1-4d74-9f17-6df83ab633d4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:12.485576 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8214f-2bb1-4d74-9f17-6df83ab633d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:12.485853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f8214f-2bb1-4d74-9f17-6df83ab633d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:12.486578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8214f-2bb1-4d74-9f17-6df83ab633d4 None admin] RBAC: Adding query filter params (role.id=0d86157ab7ad4f868971f9264e092bb0, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=344aa2356f0c4d8fb88e7c35603a65c0) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:12.486891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8214f-2bb1-4d74-9f17-6df83ab633d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:12.488364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f8214f-2bb1-4d74-9f17-6df83ab633d4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:12.494018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 557/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:12 2022] GET /identity/v3/role_assignments?user.id=344aa2356f0c4d8fb88e7c35603a65c0&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0d86157ab7ad4f868971f9264e092bb0 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:13.417500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05bb4e-fd08-4289-b4ba-f96cc781d0a0 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:13.418020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05bb4e-fd08-4289-b4ba-f96cc781d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:13.418111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05bb4e-fd08-4289-b4ba-f96cc781d0a0 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:13.419378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 550/1107] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:13.425112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5758dc-5024-424c-976d-ea7b9f4061e4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:13.425554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5758dc-5024-424c-976d-ea7b9f4061e4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:13.425650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5758dc-5024-424c-976d-ea7b9f4061e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:13.443695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ae5758dc-5024-424c-976d-ea7b9f4061e4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:13.444897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ae5758dc-5024-424c-976d-ea7b9f4061e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:13.509051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 558/1108] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:13.776132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05bb4e-fd08-4289-b4ba-f96cc781d0a0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:13.875114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05bb4e-fd08-4289-b4ba-f96cc781d0a0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:13.902796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:13.908017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa2ba8-8903-4f30-89e8-ad29cb71cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:13.908663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2ba8-8903-4f30-89e8-ad29cb71cf49 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:13.908950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2ba8-8903-4f30-89e8-ad29cb71cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:13.909232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa2ba8-8903-4f30-89e8-ad29cb71cf49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:13.910339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa2ba8-8903-4f30-89e8-ad29cb71cf49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:13.911775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa2ba8-8903-4f30-89e8-ad29cb71cf49 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:13.913350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 551/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:13.918977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5758dc-5024-424c-976d-ea7b9f4061e4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:14.014898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5758dc-5024-424c-976d-ea7b9f4061e4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:14.017137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:14.047580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84986d-24a1-4ea1-944d-a4edde401646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:14.048114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84986d-24a1-4ea1-944d-a4edde401646 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:14.048423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84986d-24a1-4ea1-944d-a4edde401646 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:14.048703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84986d-24a1-4ea1-944d-a4edde401646 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:14.049343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84986d-24a1-4ea1-944d-a4edde401646 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:14.050778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84986d-24a1-4ea1-944d-a4edde401646 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:14.136607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 559/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:33:13 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:33:16.043013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd93b6-fae0-4183-9a8c-f147a88179fe None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:16.043541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd93b6-fae0-4183-9a8c-f147a88179fe None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:16.043541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd93b6-fae0-4183-9a8c-f147a88179fe None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:16.044935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 552/1111] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:16.050116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451403e5-e179-4889-9619-81b160ec97ad None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:16.050552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451403e5-e179-4889-9619-81b160ec97ad None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:16.050677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451403e5-e179-4889-9619-81b160ec97ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:16.068753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-451403e5-e179-4889-9619-81b160ec97ad None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:16.069929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-451403e5-e179-4889-9619-81b160ec97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:16.133724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 560/1112] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:16.398725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd93b6-fae0-4183-9a8c-f147a88179fe None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:16.496556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd93b6-fae0-4183-9a8c-f147a88179fe None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:16.531298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:16.531910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:16.532210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:16.532495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] PATH_INFO: `/v3/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:16.533887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] RBAC: Authorizing `identity:get_role(role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:16.535254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:16.536606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 553/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:16 2022] GET /identity/v3/roles/bde35a779ee4459c84bc6cc697de4145 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:16.542337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451403e5-e179-4889-9619-81b160ec97ad None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:16.663368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:16.672830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451403e5-e179-4889-9619-81b160ec97ad None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:16.706475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:16.707097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:16.707380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:16.707658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] PATH_INFO: `/v3/users/31805b39a7f64ccd8db78f773e32d248` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:16.720378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] RBAC: Authorizing `identity:get_user(user_id=31805b39a7f64ccd8db78f773e32d248)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:16.721810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:16.723382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 561/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:16 2022] GET /identity/v3/users/31805b39a7f64ccd8db78f773e32d248 => generated 286 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:16.729173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:16.793399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:16.825091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e60294-96c6-4c77-ac8a-bf2cd51d5575 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:16.857725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:16.858315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:16.858598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:16.858877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:16.922846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:16.924258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:16.985663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:17.018330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 554/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:17.024209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:17.119928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323226e8-e309-45ce-9cb6-200fbce5bdbd None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:17.151789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b03e45-d776-427d-8013-b4fda257cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:17.152423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03e45-d776-427d-8013-b4fda257cc1f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:17.152710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03e45-d776-427d-8013-b4fda257cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:17.152990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b03e45-d776-427d-8013-b4fda257cc1f None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:17.154096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b03e45-d776-427d-8013-b4fda257cc1f None admin] RBAC: Authorizing `identity:get_project(project_id=6c2059ea30a242bbbfda4fda1f48722a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:17.155516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b03e45-d776-427d-8013-b4fda257cc1f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:17.157644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 562/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:17 2022] GET /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:17.163526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:17.259512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96307d33-bbe2-4260-8052-d31e568c91f5 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:17.294575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c782f-8094-474f-8f0c-dd25945065f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:17.295179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c782f-8094-474f-8f0c-dd25945065f5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:17.295460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c782f-8094-474f-8f0c-dd25945065f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:17.295736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c782f-8094-474f-8f0c-dd25945065f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:17.296505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c782f-8094-474f-8f0c-dd25945065f5 None admin] RBAC: Adding query filter params (role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=6c2059ea30a242bbbfda4fda1f48722a, user.id=31805b39a7f64ccd8db78f773e32d248) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:17.296827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c782f-8094-474f-8f0c-dd25945065f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:17.298254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c782f-8094-474f-8f0c-dd25945065f5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:17.303401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 555/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:17 2022] GET /identity/v3/role_assignments?user.id=31805b39a7f64ccd8db78f773e32d248&scope.project.id=6c2059ea30a242bbbfda4fda1f48722a&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:19.152279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c851-7840-4b41-a96e-5bc3b3d27639 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:19.152806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c851-7840-4b41-a96e-5bc3b3d27639 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:19.152806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c851-7840-4b41-a96e-5bc3b3d27639 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:19.154161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 563/1118] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:19.159370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea88d5-cf6c-4853-a393-cc5470e7f622 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:19.159793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea88d5-cf6c-4853-a393-cc5470e7f622 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:19.159920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea88d5-cf6c-4853-a393-cc5470e7f622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:19.177353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-0bea88d5-cf6c-4853-a393-cc5470e7f622 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:19.178518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0bea88d5-cf6c-4853-a393-cc5470e7f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:19.203704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:19.241932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 556/1119] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:33:19.509668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c851-7840-4b41-a96e-5bc3b3d27639 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:19.527153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:19.609523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c851-7840-4b41-a96e-5bc3b3d27639 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:19.642348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:19.642972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:19.643256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:19.643533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] PATH_INFO: `/v3/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:19.644961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] RBAC: Authorizing `identity:get_role(role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:19.646330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:19.647656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 564/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:19 2022] GET /identity/v3/roles/bde35a779ee4459c84bc6cc697de4145 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:19.653432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea88d5-cf6c-4853-a393-cc5470e7f622 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:19.748504 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea88d5-cf6c-4853-a393-cc5470e7f622 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:19.781487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:19.782038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:19.782317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:19.782594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] PATH_INFO: `/v3/users/31805b39a7f64ccd8db78f773e32d248` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:19.783714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] RBAC: Authorizing `identity:get_user(user_id=31805b39a7f64ccd8db78f773e32d248)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:19.785173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:19.786717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 557/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:19 2022] GET /identity/v3/users/31805b39a7f64ccd8db78f773e32d248 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:19.792158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:19.872442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:19.887112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa17ee-b076-4de0-98b0-52a95c3befa2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:19.919304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cb533-b9f3-4678-b04d-5d613f4d467c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:19.920121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cb533-b9f3-4678-b04d-5d613f4d467c None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:19.920808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cb533-b9f3-4678-b04d-5d613f4d467c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:19.921087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cb533-b9f3-4678-b04d-5d613f4d467c None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:19.922806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cb533-b9f3-4678-b04d-5d613f4d467c None admin] RBAC: Authorizing `identity:get_project(project_id=6c2059ea30a242bbbfda4fda1f48722a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:19.924246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31cb533-b9f3-4678-b04d-5d613f4d467c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:19.925854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 565/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:19 2022] GET /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:19.931717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:19.960988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:20.028142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73610fd-9ef0-4417-a8fd-bdf517dd6b7a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:20.061789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6be7cb-5da9-4ee7-92f2-7b308a4d8315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:20.062413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be7cb-5da9-4ee7-92f2-7b308a4d8315 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:20.062702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be7cb-5da9-4ee7-92f2-7b308a4d8315 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:20.062984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6be7cb-5da9-4ee7-92f2-7b308a4d8315 None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a/users/31805b39a7f64ccd8db78f773e32d248/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:20.065174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6be7cb-5da9-4ee7-92f2-7b308a4d8315 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c2059ea30a242bbbfda4fda1f48722a, user_id=31805b39a7f64ccd8db78f773e32d248, role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:20.066596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6be7cb-5da9-4ee7-92f2-7b308a4d8315 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:20.133904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 558/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:33:19 2022] PUT /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a/users/31805b39a7f64ccd8db78f773e32d248/roles/bde35a779ee4459c84bc6cc697de4145 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:33:21.996430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97288f-7ad0-4326-a7f7-4d06306ae95f None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:21.997022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97288f-7ad0-4326-a7f7-4d06306ae95f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:21.997022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97288f-7ad0-4326-a7f7-4d06306ae95f None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:21.998328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 566/1124] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:22.003502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd89af-1904-4df2-b3d3-edf64e566829 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:22.003903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd89af-1904-4df2-b3d3-edf64e566829 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:22.004058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd89af-1904-4df2-b3d3-edf64e566829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:22.022108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-08bd89af-1904-4df2-b3d3-edf64e566829 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:22.023288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-08bd89af-1904-4df2-b3d3-edf64e566829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:22.087655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 559/1125] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:33:22.355209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97288f-7ad0-4326-a7f7-4d06306ae95f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:22.452914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97288f-7ad0-4326-a7f7-4d06306ae95f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:22.485450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:22.486066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:22.486351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:22.486627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] PATH_INFO: `/v3/roles/bde35a779ee4459c84bc6cc697de4145` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:22.488024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] RBAC: Authorizing `identity:get_role(role_id=bde35a779ee4459c84bc6cc697de4145)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:22.489411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:22.490708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 567/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:22 2022] GET /identity/v3/roles/bde35a779ee4459c84bc6cc697de4145 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:22.496362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd89af-1904-4df2-b3d3-edf64e566829 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:22.517197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:22.592145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd89af-1904-4df2-b3d3-edf64e566829 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:22.624926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:22.625563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:22.625827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:22.626101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] PATH_INFO: `/v3/users/31805b39a7f64ccd8db78f773e32d248` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:22.627223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] RBAC: Authorizing `identity:get_user(user_id=31805b39a7f64ccd8db78f773e32d248)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:22.628677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:22.630221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 560/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:22 2022] GET /identity/v3/users/31805b39a7f64ccd8db78f773e32d248 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:22.635938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:22.656789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:22.734437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81d015-774e-4fda-aee3-9ff8c6e594fa None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:22.768034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:22.768668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:22.768952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:22.769231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:22.833764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:22.835198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:22.854792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:22.929039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 568/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:22.934970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:23.018519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:23.029893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ee216-e726-4988-b038-4af8da367248 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:23.062863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13b6d8-7b1e-4d59-bf32-5c855bafbfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:23.063477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b6d8-7b1e-4d59-bf32-5c855bafbfb5 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:23.063759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b6d8-7b1e-4d59-bf32-5c855bafbfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:23.064034 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13b6d8-7b1e-4d59-bf32-5c855bafbfb5 None admin] PATH_INFO: `/v3/projects/6c2059ea30a242bbbfda4fda1f48722a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:23.065168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13b6d8-7b1e-4d59-bf32-5c855bafbfb5 None admin] RBAC: Authorizing `identity:get_project(project_id=6c2059ea30a242bbbfda4fda1f48722a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:23.066593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13b6d8-7b1e-4d59-bf32-5c855bafbfb5 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:23.068182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 561/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:22 2022] GET /identity/v3/projects/6c2059ea30a242bbbfda4fda1f48722a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:23.074157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:23.169759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f494c5e4-28ea-45ec-9fe4-29f3fa971660 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:23.188691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:23.201770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcb226-12e8-4a2a-be57-0b3fafb6eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:23.202867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcb226-12e8-4a2a-be57-0b3fafb6eba8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:23.203147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcb226-12e8-4a2a-be57-0b3fafb6eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:23.203418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcb226-12e8-4a2a-be57-0b3fafb6eba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:23.204133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcb226-12e8-4a2a-be57-0b3fafb6eba8 None admin] RBAC: Adding query filter params (role.id=bde35a779ee4459c84bc6cc697de4145, scope.project.id=6c2059ea30a242bbbfda4fda1f48722a, user.id=31805b39a7f64ccd8db78f773e32d248) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:23.204471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcb226-12e8-4a2a-be57-0b3fafb6eba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:23.205881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcb226-12e8-4a2a-be57-0b3fafb6eba8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:23.211588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 569/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:23 2022] GET /identity/v3/role_assignments?user.id=31805b39a7f64ccd8db78f773e32d248&scope.project.id=6c2059ea30a242bbbfda4fda1f48722a&role.id=bde35a779ee4459c84bc6cc697de4145 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:25.094576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395013af-d71b-49cd-a9e1-20d6dd5f1d08 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:25.095134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395013af-d71b-49cd-a9e1-20d6dd5f1d08 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:25.095134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395013af-d71b-49cd-a9e1-20d6dd5f1d08 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:25.096484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 562/1131] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:25.101585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900386e-8550-4eb8-b4ca-12ba68a1c996 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:25.102009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900386e-8550-4eb8-b4ca-12ba68a1c996 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:25.102141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900386e-8550-4eb8-b4ca-12ba68a1c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:25.119603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f900386e-8550-4eb8-b4ca-12ba68a1c996 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:25.120811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f900386e-8550-4eb8-b4ca-12ba68a1c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:25.185221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 570/1132] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:33:25.452580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395013af-d71b-49cd-a9e1-20d6dd5f1d08 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:25.549057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395013af-d71b-49cd-a9e1-20d6dd5f1d08 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:25.581422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99fe7-ae17-48dc-bac1-90a17cb34735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:25.582035 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99fe7-ae17-48dc-bac1-90a17cb34735 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:25.582319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99fe7-ae17-48dc-bac1-90a17cb34735 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:25.582596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99fe7-ae17-48dc-bac1-90a17cb34735 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:25.583960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99fe7-ae17-48dc-bac1-90a17cb34735 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:25.585432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99fe7-ae17-48dc-bac1-90a17cb34735 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:25.586959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 563/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:25.592496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900386e-8550-4eb8-b4ca-12ba68a1c996 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:25.684991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900386e-8550-4eb8-b4ca-12ba68a1c996 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:25.698583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:25.717638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35034db4-f696-496c-acb7-79f0aede77c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:25.718197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034db4-f696-496c-acb7-79f0aede77c0 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:25.718476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034db4-f696-496c-acb7-79f0aede77c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:25.718748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35034db4-f696-496c-acb7-79f0aede77c0 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:25.719379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35034db4-f696-496c-acb7-79f0aede77c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:25.720826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35034db4-f696-496c-acb7-79f0aede77c0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:25.850280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 571/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:33:25 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:33:27.765806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338590-acd6-4118-b29d-700ea1ae445c None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:27.766375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338590-acd6-4118-b29d-700ea1ae445c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:27.766375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07338590-acd6-4118-b29d-700ea1ae445c None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:27.767684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 564/1135] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:27.773154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad483b1-0252-464f-8e24-be050ac2d700 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:27.773584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad483b1-0252-464f-8e24-be050ac2d700 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:27.773717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad483b1-0252-464f-8e24-be050ac2d700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:27.791891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-dad483b1-0252-464f-8e24-be050ac2d700 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:27.793114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-dad483b1-0252-464f-8e24-be050ac2d700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:27.858150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 572/1136] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:33:28.128352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07338590-acd6-4118-b29d-700ea1ae445c None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:28.153211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:28.225901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07338590-acd6-4118-b29d-700ea1ae445c None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:28.258532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff87455-da30-4c20-93ce-819d1b095f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:28.259153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87455-da30-4c20-93ce-819d1b095f80 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:28.259437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87455-da30-4c20-93ce-819d1b095f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:28.259714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87455-da30-4c20-93ce-819d1b095f80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:28.260842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff87455-da30-4c20-93ce-819d1b095f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:28.262282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff87455-da30-4c20-93ce-819d1b095f80 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:28.263864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 565/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:33:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:28.270174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad483b1-0252-464f-8e24-be050ac2d700 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:28.360775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:28.366406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad483b1-0252-464f-8e24-be050ac2d700 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:28.399793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7723767-b2ca-464e-9a84-96b8b4c5fc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:28.400364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723767-b2ca-464e-9a84-96b8b4c5fc57 None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:28.400649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723767-b2ca-464e-9a84-96b8b4c5fc57 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:28.400925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7723767-b2ca-464e-9a84-96b8b4c5fc57 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:28.401571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7723767-b2ca-464e-9a84-96b8b4c5fc57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:28.402994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7723767-b2ca-464e-9a84-96b8b4c5fc57 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:28.500269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 573/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:33:28 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:33:30.402374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f3f3-2c26-457e-aaee-2478ffe3f6e3 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:30.402902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f3f3-2c26-457e-aaee-2478ffe3f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:30.403004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66f3f3-2c26-457e-aaee-2478ffe3f6e3 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:30.404308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 566/1139] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:30.409550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e16255-a17a-48f5-bb15-96e636822267 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:30.409946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e16255-a17a-48f5-bb15-96e636822267 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:30.410102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e16255-a17a-48f5-bb15-96e636822267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:30.427696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-45e16255-a17a-48f5-bb15-96e636822267 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:30.428916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-45e16255-a17a-48f5-bb15-96e636822267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:30.493586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 574/1140] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:30.764594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66f3f3-2c26-457e-aaee-2478ffe3f6e3 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:30.855599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:30.865386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66f3f3-2c26-457e-aaee-2478ffe3f6e3 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:30.897904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:30.898527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:30.898813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:30.899095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:30.909081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:30.914135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:30.915299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:30.916401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 567/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:30.921730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e16255-a17a-48f5-bb15-96e636822267 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:30.998448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:31.018941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e16255-a17a-48f5-bb15-96e636822267 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:31.052473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:31.053068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:31.053346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:31.053618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:31.054276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:31.054581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:31.055940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:31.064708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 575/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:31.070614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:31.167220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0e05d0-9886-4ad1-9a96-11b519ec6929 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:31.199494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:31.200107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:31.200417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:31.200698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] PATH_INFO: `/v3/users/8ad9f8540d384fcba885e5334686c261` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:31.214207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] RBAC: Authorizing `identity:get_user(user_id=8ad9f8540d384fcba885e5334686c261)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:31.215646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:31.217247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 568/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:31 2022] GET /identity/v3/users/8ad9f8540d384fcba885e5334686c261 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:31.223445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:31.320168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46bb2bc-0d8a-40be-a25b-2f1f5fd3ad65 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:31.352233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:31.352833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:31.353113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:31.353392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:31.367353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:31.416860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:31.418285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:31.510242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 576/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:31.516593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:31.528186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:31.610970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6a868-b6a4-480a-a8c9-fb93657d6476 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:31.643081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd8470-afde-4173-b8fb-2e15b367231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:31.643691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8470-afde-4173-b8fb-2e15b367231d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:31.643971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8470-afde-4173-b8fb-2e15b367231d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:31.644269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd8470-afde-4173-b8fb-2e15b367231d None admin] PATH_INFO: `/v3/projects/7e0019d075f94824bb3fbae9c23690c6` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:31.645363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8470-afde-4173-b8fb-2e15b367231d None admin] RBAC: Authorizing `identity:get_project(project_id=7e0019d075f94824bb3fbae9c23690c6)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:31.646783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd8470-afde-4173-b8fb-2e15b367231d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:31.648376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 569/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:31 2022] GET /identity/v3/projects/7e0019d075f94824bb3fbae9c23690c6 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:31.654368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:31.698016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:31.750676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1062941a-347a-4a5c-8b4e-37d169f1d696 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:31.783469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ef21c-d61a-49d7-89c0-5b4b84e22787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:31.784055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef21c-d61a-49d7-89c0-5b4b84e22787 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:31.784367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef21c-d61a-49d7-89c0-5b4b84e22787 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:31.784647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ef21c-d61a-49d7-89c0-5b4b84e22787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:31.785363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ef21c-d61a-49d7-89c0-5b4b84e22787 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=7e0019d075f94824bb3fbae9c23690c6, user.id=8ad9f8540d384fcba885e5334686c261) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:31.785674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ef21c-d61a-49d7-89c0-5b4b84e22787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:31.787093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ef21c-d61a-49d7-89c0-5b4b84e22787 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:31.792282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 577/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:31 2022] GET /identity/v3/role_assignments?user.id=8ad9f8540d384fcba885e5334686c261&scope.project.id=7e0019d075f94824bb3fbae9c23690c6&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:33.629821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1b6f-8f8e-4d62-a88b-b4b4b922c4d8 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:33.630373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1b6f-8f8e-4d62-a88b-b4b4b922c4d8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:33.630373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce1b6f-8f8e-4d62-a88b-b4b4b922c4d8 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:33.631696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 570/1147] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:33.636846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0c86-da6d-4925-b807-79f2558dfb13 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:33.637233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0c86-da6d-4925-b807-79f2558dfb13 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:33.637415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d0c86-da6d-4925-b807-79f2558dfb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:33.655667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9d7d0c86-da6d-4925-b807-79f2558dfb13 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:33.656890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9d7d0c86-da6d-4925-b807-79f2558dfb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:33.721339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 578/1148] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:33.986830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce1b6f-8f8e-4d62-a88b-b4b4b922c4d8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:34.062734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:34.084057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ce1b6f-8f8e-4d62-a88b-b4b4b922c4d8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:34.118044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:34.119078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:34.119574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:34.120047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:34.132312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:34.136861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:34.137954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:34.138999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 571/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:34.143962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0c86-da6d-4925-b807-79f2558dfb13 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:34.182696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:34.239977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d0c86-da6d-4925-b807-79f2558dfb13 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:34.272168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:34.272813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:34.273096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:34.273378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:34.274042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:34.274349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:34.275712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:34.284060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 579/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:34.289913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:34.385795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21337b-735b-4f39-bad3-f29fb8ca33a6 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:34.418538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:34.419149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:34.419432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:34.419710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] PATH_INFO: `/v3/users/8ad9f8540d384fcba885e5334686c261` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:34.420830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] RBAC: Authorizing `identity:get_user(user_id=8ad9f8540d384fcba885e5334686c261)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:34.422287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:34.423823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 572/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:34 2022] GET /identity/v3/users/8ad9f8540d384fcba885e5334686c261 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:34.429392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:34.522785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:34.525533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f63fc-7392-4427-8581-1c6dc0509eae None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:34.558087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73806e3f-cfd3-488e-b997-394ddb02c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:34.558700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806e3f-cfd3-488e-b997-394ddb02c482 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:34.558980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806e3f-cfd3-488e-b997-394ddb02c482 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:34.559255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73806e3f-cfd3-488e-b997-394ddb02c482 None admin] PATH_INFO: `/v3/projects/7e0019d075f94824bb3fbae9c23690c6` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:34.560382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806e3f-cfd3-488e-b997-394ddb02c482 None admin] RBAC: Authorizing `identity:get_project(project_id=7e0019d075f94824bb3fbae9c23690c6)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:34.561848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73806e3f-cfd3-488e-b997-394ddb02c482 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:34.563440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 580/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:34 2022] GET /identity/v3/projects/7e0019d075f94824bb3fbae9c23690c6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:34.569129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:34.578097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:34.665967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7865d67f-316e-45cf-90f8-62dc1972a11c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:34.697189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3eed5-0bbd-4f28-8ab0-38ee43531830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:34.697826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3eed5-0bbd-4f28-8ab0-38ee43531830 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:34.698113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3eed5-0bbd-4f28-8ab0-38ee43531830 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:34.698392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3eed5-0bbd-4f28-8ab0-38ee43531830 None admin] PATH_INFO: `/v3/projects/7e0019d075f94824bb3fbae9c23690c6/users/8ad9f8540d384fcba885e5334686c261/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:34.700299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3eed5-0bbd-4f28-8ab0-38ee43531830 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e0019d075f94824bb3fbae9c23690c6, user_id=8ad9f8540d384fcba885e5334686c261, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:34.701729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3eed5-0bbd-4f28-8ab0-38ee43531830 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:34.779358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 573/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:33:34 2022] PUT /identity/v3/projects/7e0019d075f94824bb3fbae9c23690c6/users/8ad9f8540d384fcba885e5334686c261/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:33:36.648663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23ba25-9214-494e-896f-664319dc45a3 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:36.649174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23ba25-9214-494e-896f-664319dc45a3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:36.649266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23ba25-9214-494e-896f-664319dc45a3 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:36.650569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 581/1154] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:36.656411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aca41b-ee83-41a1-a94f-8c54a58fabfb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:36.656850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aca41b-ee83-41a1-a94f-8c54a58fabfb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:36.656975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aca41b-ee83-41a1-a94f-8c54a58fabfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:36.674507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-42aca41b-ee83-41a1-a94f-8c54a58fabfb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:36.675689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-42aca41b-ee83-41a1-a94f-8c54a58fabfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:36.732622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:36.739714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 574/1155] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:37.003550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23ba25-9214-494e-896f-664319dc45a3 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:37.101840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23ba25-9214-494e-896f-664319dc45a3 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:37.134361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:37.134972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:37.135258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:37.135536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:37.145908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:37.150552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:37.151656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:37.152683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 582/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:37.157520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aca41b-ee83-41a1-a94f-8c54a58fabfb None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:37.253678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aca41b-ee83-41a1-a94f-8c54a58fabfb None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:37.286527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:37.287136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:37.287423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:37.287701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:37.288396 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:37.288709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:37.290114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:37.298442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 575/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:37.304579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:37.334034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:37.402938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b5b64-44cb-4bc3-b48f-f65ad69bf78f None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:37.435431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:37.436156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:37.436554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:37.437342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] PATH_INFO: `/v3/users/8ad9f8540d384fcba885e5334686c261` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:37.438452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] RBAC: Authorizing `identity:get_user(user_id=8ad9f8540d384fcba885e5334686c261)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:37.439869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:37.441463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 583/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:37 2022] GET /identity/v3/users/8ad9f8540d384fcba885e5334686c261 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:37.447186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:37.503410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:37.543461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ded57-f227-47a5-8d5d-fd14577e03df None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:37.576199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:37.576818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:37.577106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:37.577381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:37.641316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:37.642775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:37.696255 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:37.736736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 576/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:37.742537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:37.832238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:37.838031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6c38-155e-4375-aa20-14512603eac4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:37.871543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46637834-1088-494a-b325-f0f3071985e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:37.872163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637834-1088-494a-b325-f0f3071985e3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:37.872480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637834-1088-494a-b325-f0f3071985e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:37.872759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46637834-1088-494a-b325-f0f3071985e3 None admin] PATH_INFO: `/v3/projects/7e0019d075f94824bb3fbae9c23690c6` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:37.873865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637834-1088-494a-b325-f0f3071985e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7e0019d075f94824bb3fbae9c23690c6)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:37.875311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46637834-1088-494a-b325-f0f3071985e3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:37.876952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 584/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:37 2022] GET /identity/v3/projects/7e0019d075f94824bb3fbae9c23690c6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:37.882974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:37.976862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852702e1-908a-4e98-a72f-e98f4b198cd9 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:38.009169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47876e4-6667-400f-b07b-3cf29cdfc165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:38.009757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47876e4-6667-400f-b07b-3cf29cdfc165 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:38.010041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47876e4-6667-400f-b07b-3cf29cdfc165 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:38.010316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47876e4-6667-400f-b07b-3cf29cdfc165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:38.011040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47876e4-6667-400f-b07b-3cf29cdfc165 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=7e0019d075f94824bb3fbae9c23690c6, user.id=8ad9f8540d384fcba885e5334686c261) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:38.011352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47876e4-6667-400f-b07b-3cf29cdfc165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:38.012807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47876e4-6667-400f-b07b-3cf29cdfc165 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:38.018313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 577/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:37 2022] GET /identity/v3/role_assignments?user.id=8ad9f8540d384fcba885e5334686c261&scope.project.id=7e0019d075f94824bb3fbae9c23690c6&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:39.902218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3ddc-e585-4968-a9b9-fb76d86870a8 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:39.902767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3ddc-e585-4968-a9b9-fb76d86870a8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:39.902767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f3ddc-e585-4968-a9b9-fb76d86870a8 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:39.904116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 585/1162] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:39.909761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef514d-58c9-4ab9-b68d-d85b62114f41 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:39.910208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef514d-58c9-4ab9-b68d-d85b62114f41 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:39.910301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef514d-58c9-4ab9-b68d-d85b62114f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:39.927953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d1ef514d-58c9-4ab9-b68d-d85b62114f41 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:39.929157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d1ef514d-58c9-4ab9-b68d-d85b62114f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:39.944965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:39.993377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 578/1163] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:40.257413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f3ddc-e585-4968-a9b9-fb76d86870a8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:40.359481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f3ddc-e585-4968-a9b9-fb76d86870a8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:40.392753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:40.393343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:40.393624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:40.393899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:40.423473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:40.458893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:40.460357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:40.553961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 586/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:40.559776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef514d-58c9-4ab9-b68d-d85b62114f41 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:40.655258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef514d-58c9-4ab9-b68d-d85b62114f41 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:40.688989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f0594-ffd1-42b9-9ffd-70d82cb0ae62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:40.689603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f0594-ffd1-42b9-9ffd-70d82cb0ae62 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:40.689888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f0594-ffd1-42b9-9ffd-70d82cb0ae62 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:40.690166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f0594-ffd1-42b9-9ffd-70d82cb0ae62 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:40.696561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f0594-ffd1-42b9-9ffd-70d82cb0ae62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:40.698008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f0594-ffd1-42b9-9ffd-70d82cb0ae62 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-f16f0594-ffd1-42b9-9ffd-70d82cb0ae62 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:40.709207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:40.710318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:40.711291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 579/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:33:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:40.716322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:40.775596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:40.812122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419629c-7fec-48c1-97e5-a13b9ad1f3e4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:40.845053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827cbda-3b92-4f39-857a-d6005422f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:40.845645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827cbda-3b92-4f39-857a-d6005422f771 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:40.845929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827cbda-3b92-4f39-857a-d6005422f771 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:40.846205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827cbda-3b92-4f39-857a-d6005422f771 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:40.846839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827cbda-3b92-4f39-857a-d6005422f771 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:40.847145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827cbda-3b92-4f39-857a-d6005422f771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:40.848523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827cbda-3b92-4f39-857a-d6005422f771 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:40.855311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 587/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Aug 22 05:33:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:42.731711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a278-e6fb-464d-b5c0-5a587bf79f87 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:42.732286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a278-e6fb-464d-b5c0-5a587bf79f87 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:42.732286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3a278-e6fb-464d-b5c0-5a587bf79f87 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:42.733688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 580/1167] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:42.738906 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762900bf-fd1f-4107-8c15-ff90682321b3 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:42.739301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762900bf-fd1f-4107-8c15-ff90682321b3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:42.739471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762900bf-fd1f-4107-8c15-ff90682321b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:42.757062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-762900bf-fd1f-4107-8c15-ff90682321b3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:42.758231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-762900bf-fd1f-4107-8c15-ff90682321b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:42.821460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 588/1168] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:43.088684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3a278-e6fb-464d-b5c0-5a587bf79f87 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:43.103459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:43.185254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3a278-e6fb-464d-b5c0-5a587bf79f87 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:43.218346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c750e8-35f7-4094-b891-8b898c5570e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:43.218933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c750e8-35f7-4094-b891-8b898c5570e9 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:43.219214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c750e8-35f7-4094-b891-8b898c5570e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:43.219490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c750e8-35f7-4094-b891-8b898c5570e9 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:43.220157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c750e8-35f7-4094-b891-8b898c5570e9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:43.221558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c750e8-35f7-4094-b891-8b898c5570e9 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:43.358212 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 581/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Mon Aug 22 05:33:43 2022] POST /identity/v3/domains => generated 267 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:33:45.270759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f3ea-d338-497a-9bb1-782fec3cf120 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:45.271289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f3ea-d338-497a-9bb1-782fec3cf120 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:45.271289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f3ea-d338-497a-9bb1-782fec3cf120 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:45.272699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 589/1170] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:45.277949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f42f0-23f4-49f6-80fd-99fb29a54a5d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:45.278321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f42f0-23f4-49f6-80fd-99fb29a54a5d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:45.278520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f42f0-23f4-49f6-80fd-99fb29a54a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:45.297158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-025f42f0-23f4-49f6-80fd-99fb29a54a5d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:45.298389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-025f42f0-23f4-49f6-80fd-99fb29a54a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:45.362613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 582/1171] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:45.629849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6f3ea-d338-497a-9bb1-782fec3cf120 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:45.688001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:45.727689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6f3ea-d338-497a-9bb1-782fec3cf120 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:45.760772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303736c7-2d52-439d-9380-4061c8e208e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:45.761389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303736c7-2d52-439d-9380-4061c8e208e4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:45.761674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303736c7-2d52-439d-9380-4061c8e208e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:45.761958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303736c7-2d52-439d-9380-4061c8e208e4 None admin] PATH_INFO: `/v3/domains/ea8cbbb2871944a08985ccf5458ced75` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:45.771857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303736c7-2d52-439d-9380-4061c8e208e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea8cbbb2871944a08985ccf5458ced75)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:45.773329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303736c7-2d52-439d-9380-4061c8e208e4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:45.774876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 590/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Aug 22 05:33:45 2022] GET /identity/v3/domains/ea8cbbb2871944a08985ccf5458ced75 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:45.780545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f42f0-23f4-49f6-80fd-99fb29a54a5d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:45.782730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:45.877188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f42f0-23f4-49f6-80fd-99fb29a54a5d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:45.908884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe999c-0006-4390-87fc-5a17ec9ab559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:45.909423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe999c-0006-4390-87fc-5a17ec9ab559 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:45.909707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe999c-0006-4390-87fc-5a17ec9ab559 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:45.909981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe999c-0006-4390-87fc-5a17ec9ab559 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:45.910631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe999c-0006-4390-87fc-5a17ec9ab559 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:45.912066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe999c-0006-4390-87fc-5a17ec9ab559 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:46.027761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 583/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:33:45 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:33:47.910806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763f87-c877-42eb-9d84-12119db27fd3 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:47.911365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763f87-c877-42eb-9d84-12119db27fd3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:47.911365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763f87-c877-42eb-9d84-12119db27fd3 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:47.912747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 591/1174] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:47.917807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37246-124c-4fc6-b4c6-f6a6f20db35f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:47.918188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37246-124c-4fc6-b4c6-f6a6f20db35f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:47.918364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced37246-124c-4fc6-b4c6-f6a6f20db35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:47.935817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ced37246-124c-4fc6-b4c6-f6a6f20db35f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:47.937016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ced37246-124c-4fc6-b4c6-f6a6f20db35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:47.984486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:48.000857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 584/1175] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:48.269299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d763f87-c877-42eb-9d84-12119db27fd3 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:48.369822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d763f87-c877-42eb-9d84-12119db27fd3 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:48.387279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:48.403903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da7343-7943-414f-9574-81a78e46b6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:48.404581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7343-7943-414f-9574-81a78e46b6dd None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:48.404868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7343-7943-414f-9574-81a78e46b6dd None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:48.405150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da7343-7943-414f-9574-81a78e46b6dd None admin] PATH_INFO: `/v3/domains/ea8cbbb2871944a08985ccf5458ced75` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:48.406262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7343-7943-414f-9574-81a78e46b6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=ea8cbbb2871944a08985ccf5458ced75)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:48.407764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da7343-7943-414f-9574-81a78e46b6dd None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:48.409377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 592/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Aug 22 05:33:48 2022] GET /identity/v3/domains/ea8cbbb2871944a08985ccf5458ced75 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:48.415257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced37246-124c-4fc6-b4c6-f6a6f20db35f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:48.509693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced37246-124c-4fc6-b4c6-f6a6f20db35f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:48.542692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd085cf2-fefe-43f0-aae1-42d54fca80a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:48.543223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd085cf2-fefe-43f0-aae1-42d54fca80a7 None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:48.543503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd085cf2-fefe-43f0-aae1-42d54fca80a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:48.543779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd085cf2-fefe-43f0-aae1-42d54fca80a7 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:48.544454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd085cf2-fefe-43f0-aae1-42d54fca80a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:48.546473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd085cf2-fefe-43f0-aae1-42d54fca80a7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:48.653161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 585/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:33:48 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:33:50.579647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae26fa-b4f4-410a-8545-a37b82d52d59 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:50.580145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae26fa-b4f4-410a-8545-a37b82d52d59 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:50.580145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae26fa-b4f4-410a-8545-a37b82d52d59 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:50.581477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 593/1178] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:50.587089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5da6a6-e533-459d-a602-8e0ef7ade8f2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:50.587515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5da6a6-e533-459d-a602-8e0ef7ade8f2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:50.587645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5da6a6-e533-459d-a602-8e0ef7ade8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:50.605341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8c5da6a6-e533-459d-a602-8e0ef7ade8f2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:50.606519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8c5da6a6-e533-459d-a602-8e0ef7ade8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:50.639628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:50.669981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 586/1179] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:50.939905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae26fa-b4f4-410a-8545-a37b82d52d59 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:51.039062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae26fa-b4f4-410a-8545-a37b82d52d59 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:51.071846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:51.072494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:51.072773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:51.073043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:51.082856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:51.087426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:51.088639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:51.089884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 594/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:51.094492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5da6a6-e533-459d-a602-8e0ef7ade8f2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:51.188453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5da6a6-e533-459d-a602-8e0ef7ade8f2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:51.220419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:51.220955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:51.221235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:51.221510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:51.222177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:51.222485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:51.223863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:51.231791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 587/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:51.238109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:51.350263 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:51.400481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9c8ba-d422-4c88-9104-cf2cbc1963b6 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:51.433560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:51.434180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:51.434462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:51.434737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] PATH_INFO: `/v3/users/cae13bb35ef84c418c0825d3d0179967` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:51.447185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] RBAC: Authorizing `identity:get_user(user_id=cae13bb35ef84c418c0825d3d0179967)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:51.448644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:51.450226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 595/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:51 2022] GET /identity/v3/users/cae13bb35ef84c418c0825d3d0179967 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:51.456113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:51.487225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:51.552455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6861a8a-a789-44b5-9b8f-59132b898eed None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:51.584499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:51.585098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:51.585380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:51.585660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:51.649630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:51.651075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:51.679333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:51.744763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 588/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:51.750614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:51.847276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7037c1-1d75-4984-83a1-3c8a8f0f842a None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:51.849537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:51.879463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b1b62-582a-4694-bc43-2db48625d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:51.880085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b1b62-582a-4694-bc43-2db48625d926 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:51.880391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b1b62-582a-4694-bc43-2db48625d926 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:51.880666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b1b62-582a-4694-bc43-2db48625d926 None admin] PATH_INFO: `/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:51.881959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b1b62-582a-4694-bc43-2db48625d926 None admin] RBAC: Authorizing `identity:get_project(project_id=4a010821f3b04c95b82f4d53b7ddc1b9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:51.883653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b1b62-582a-4694-bc43-2db48625d926 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:51.885562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 596/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:51 2022] GET /identity/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:51.892218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:51.987400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bd305-5d5d-4244-87a4-d5d650d1797d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:52.014760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:52.019366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2443f-5129-47d7-a98c-676f6fcccaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:52.019953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2443f-5129-47d7-a98c-676f6fcccaba None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:52.020254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2443f-5129-47d7-a98c-676f6fcccaba None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:52.020530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2443f-5129-47d7-a98c-676f6fcccaba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:52.021294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2443f-5129-47d7-a98c-676f6fcccaba None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=4a010821f3b04c95b82f4d53b7ddc1b9, user.id=cae13bb35ef84c418c0825d3d0179967) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:52.021603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2443f-5129-47d7-a98c-676f6fcccaba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:52.023016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2443f-5129-47d7-a98c-676f6fcccaba None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:52.028254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 589/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:51 2022] GET /identity/v3/role_assignments?user.id=cae13bb35ef84c418c0825d3d0179967&scope.project.id=4a010821f3b04c95b82f4d53b7ddc1b9&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:53.886118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc531-171b-4fdc-b326-ea80f1b57cfa None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:53.886682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc531-171b-4fdc-b326-ea80f1b57cfa None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:53.886682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc531-171b-4fdc-b326-ea80f1b57cfa None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:53.888015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 597/1186] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:53.893754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7308-7a7a-4422-bcb4-7f914fbc9a1e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:53.894180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7308-7a7a-4422-bcb4-7f914fbc9a1e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:53.894286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d7308-7a7a-4422-bcb4-7f914fbc9a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:53.911646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-101d7308-7a7a-4422-bcb4-7f914fbc9a1e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:53.912848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-101d7308-7a7a-4422-bcb4-7f914fbc9a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:53.976588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 590/1187] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:54.244817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bc531-171b-4fdc-b326-ea80f1b57cfa None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:54.344317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bc531-171b-4fdc-b326-ea80f1b57cfa None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:54.376435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:54.377051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:54.377331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:54.377605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:54.387166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:54.392364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:54.393476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:33:54.394676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 598/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:54.399466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7308-7a7a-4422-bcb4-7f914fbc9a1e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:54.494009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d7308-7a7a-4422-bcb4-7f914fbc9a1e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:54.519181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:54.527453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:54.530087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:54.530087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:54.530087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:54.530087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:54.530087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:54.531176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:54.538935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 591/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:54.544866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:54.575603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:54.642043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc049ea6-9a79-4c5c-ad09-3a40688266ff None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:54.675336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:54.675949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:54.676262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:54.676545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] PATH_INFO: `/v3/users/cae13bb35ef84c418c0825d3d0179967` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:54.677651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=cae13bb35ef84c418c0825d3d0179967)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:54.679068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:54.680672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 599/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:54 2022] GET /identity/v3/users/cae13bb35ef84c418c0825d3d0179967 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:54.686872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:54.783395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412645ac-c36f-47f5-a71c-d0c31eaa4a3a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:54.816582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c42c2-0064-4850-929c-e3767f3da3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:54.817198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c42c2-0064-4850-929c-e3767f3da3cd None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:54.817483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c42c2-0064-4850-929c-e3767f3da3cd None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:54.817759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c42c2-0064-4850-929c-e3767f3da3cd None admin] PATH_INFO: `/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:54.818861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c42c2-0064-4850-929c-e3767f3da3cd None admin] RBAC: Authorizing `identity:get_project(project_id=4a010821f3b04c95b82f4d53b7ddc1b9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:54.820324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c42c2-0064-4850-929c-e3767f3da3cd None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:54.821920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 592/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:54 2022] GET /identity/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:33:54.827665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:54.920120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:54.923082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70862e3b-65e3-43a9-acc4-0f0378c81ef8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:54.955581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90cdaa9-198f-40e2-b743-fbedb354fba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:54.956256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cdaa9-198f-40e2-b743-fbedb354fba8 None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:54.956533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cdaa9-198f-40e2-b743-fbedb354fba8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:54.956805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90cdaa9-198f-40e2-b743-fbedb354fba8 None admin] PATH_INFO: `/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9/users/cae13bb35ef84c418c0825d3d0179967/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:54.958929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cdaa9-198f-40e2-b743-fbedb354fba8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a010821f3b04c95b82f4d53b7ddc1b9, user_id=cae13bb35ef84c418c0825d3d0179967, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:54.960372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90cdaa9-198f-40e2-b743-fbedb354fba8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:55.037671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 600/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:33:54 2022] PUT /identity/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9/users/cae13bb35ef84c418c0825d3d0179967/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:33:56.885196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188470be-4fb7-468f-b5f7-8bb7557556ca None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:56.885747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188470be-4fb7-468f-b5f7-8bb7557556ca None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:56.885747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188470be-4fb7-468f-b5f7-8bb7557556ca None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:56.887071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 593/1193] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:33:56.892868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67de1-d509-4966-b4b2-ef3d44d4c33d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:56.893287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67de1-d509-4966-b4b2-ef3d44d4c33d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:56.893426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67de1-d509-4966-b4b2-ef3d44d4c33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:56.910789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-69f67de1-d509-4966-b4b2-ef3d44d4c33d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:33:56.911954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-69f67de1-d509-4966-b4b2-ef3d44d4c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:33:56.975337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 601/1194] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:33:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:33:57.250704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188470be-4fb7-468f-b5f7-8bb7557556ca None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:57.301599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:57.344036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188470be-4fb7-468f-b5f7-8bb7557556ca None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:57.375935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:57.376573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:57.376854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:57.377129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:57.387109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:33:57.391827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:33:57.392920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:33:57.394042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 594/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:33:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:33:57.398865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67de1-d509-4966-b4b2-ef3d44d4c33d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:57.485245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:57.494276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67de1-d509-4966-b4b2-ef3d44d4c33d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:57.526302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:57.526840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:57.527149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:57.527447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:57.528143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:57.528535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:57.530403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:57.538120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 602/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:33:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:57.543693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:57.637538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d39670-8c21-4a31-8a38-aeabd76a7402 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:57.652927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:57.670065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:57.670667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:57.670947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:57.671270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] PATH_INFO: `/v3/users/cae13bb35ef84c418c0825d3d0179967` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:57.672442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] RBAC: Authorizing `identity:get_user(user_id=cae13bb35ef84c418c0825d3d0179967)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:57.673868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:57.675393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 595/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Aug 22 05:33:57 2022] GET /identity/v3/users/cae13bb35ef84c418c0825d3d0179967 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:57.681127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:57.776389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8471d0-ac1d-4be7-a3ea-2a489abb3206 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:57.807980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:57.808602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:57.808884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:57.809159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:57.829515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:57.874178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:57.875621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:57.968181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 603/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:33:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:33:57.974134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:58.072759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f2d54-9f80-4e2e-ab9f-c8bed6c2984a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:58.105721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fc42e-6ed3-47cd-893d-5c78b6ec8b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:58.106328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc42e-6ed3-47cd-893d-5c78b6ec8b7c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:58.106607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc42e-6ed3-47cd-893d-5c78b6ec8b7c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:58.106920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fc42e-6ed3-47cd-893d-5c78b6ec8b7c None admin] PATH_INFO: `/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:58.108545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fc42e-6ed3-47cd-893d-5c78b6ec8b7c None admin] RBAC: Authorizing `identity:get_project(project_id=4a010821f3b04c95b82f4d53b7ddc1b9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:58.109964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fc42e-6ed3-47cd-893d-5c78b6ec8b7c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:58.111552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 596/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Aug 22 05:33:57 2022] GET /identity/v3/projects/4a010821f3b04c95b82f4d53b7ddc1b9 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:33:58.117610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:33:58.168333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:33:58.213479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59ad17-f46f-42c6-82dd-c64fc78f5561 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:33:58.246409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf0c9d-58d1-40d5-aa0b-c835984f13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:33:58.247007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf0c9d-58d1-40d5-aa0b-c835984f13c4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:33:58.247292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf0c9d-58d1-40d5-aa0b-c835984f13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:33:58.247597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf0c9d-58d1-40d5-aa0b-c835984f13c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:33:58.248356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf0c9d-58d1-40d5-aa0b-c835984f13c4 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=4a010821f3b04c95b82f4d53b7ddc1b9, user.id=cae13bb35ef84c418c0825d3d0179967) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:33:58.248670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf0c9d-58d1-40d5-aa0b-c835984f13c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:33:58.250123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf0c9d-58d1-40d5-aa0b-c835984f13c4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:33:58.255697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 604/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:33:58 2022] GET /identity/v3/role_assignments?user.id=cae13bb35ef84c418c0825d3d0179967&scope.project.id=4a010821f3b04c95b82f4d53b7ddc1b9&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:34:08.101760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=74 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:34:08.253159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=42 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:10.230282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7a7c-833b-4876-be90-ab44833dcb8a None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:10.230867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7a7c-833b-4876-be90-ab44833dcb8a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:10.230867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb7a7c-833b-4876-be90-ab44833dcb8a None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:10.232158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 597/1201] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:10.237962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd821-bb44-412b-b2cf-716fefe30430 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:10.238423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd821-bb44-412b-b2cf-716fefe30430 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:10.238524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd821-bb44-412b-b2cf-716fefe30430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:10.256732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2b7cd821-bb44-412b-b2cf-716fefe30430 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:10.257950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2b7cd821-bb44-412b-b2cf-716fefe30430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:10.325801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 605/1202] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:10.591192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7a7c-833b-4876-be90-ab44833dcb8a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:10.689543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb7a7c-833b-4876-be90-ab44833dcb8a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:10.722721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:10.723344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:10.723626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:10.723901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:10.733964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:10.735404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:10.749465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:10.750556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:10.751546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:10.751546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:10.751546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:10.751546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 598/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:10.756522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd821-bb44-412b-b2cf-716fefe30430 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:10.852935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd821-bb44-412b-b2cf-716fefe30430 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:10.879908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:10.885820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde8216-5423-4a0e-860c-b6f9e40b8b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:10.886536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde8216-5423-4a0e-860c-b6f9e40b8b64 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:10.886870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde8216-5423-4a0e-860c-b6f9e40b8b64 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:10.887149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde8216-5423-4a0e-860c-b6f9e40b8b64 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:10.887789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde8216-5423-4a0e-860c-b6f9e40b8b64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:10.888093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde8216-5423-4a0e-860c-b6f9e40b8b64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:10.889522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde8216-5423-4a0e-860c-b6f9e40b8b64 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:10.900872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 606/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:10.907423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:10.959679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:11.004765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288fec8-c95a-42d4-8da7-eccf673fb7b2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:11.037235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d93d98-089b-4e3f-b357-379a3ee8bdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:11.037832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d93d98-089b-4e3f-b357-379a3ee8bdba None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:11.038112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d93d98-089b-4e3f-b357-379a3ee8bdba None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:11.038387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d93d98-089b-4e3f-b357-379a3ee8bdba None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:11.039025 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d93d98-089b-4e3f-b357-379a3ee8bdba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:11.040480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d93d98-089b-4e3f-b357-379a3ee8bdba None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:11.163924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 599/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Aug 22 05:35:10 2022] POST /identity/v3/users => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:35:13.110999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1d6ae-e1d0-4dad-88a8-a9c302068107 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:13.111579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1d6ae-e1d0-4dad-88a8-a9c302068107 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:13.111579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1d6ae-e1d0-4dad-88a8-a9c302068107 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:13.113010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 607/1206] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:13.118358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead395cb-a74c-4ffb-a1e7-70d5b76356dc None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:13.120727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead395cb-a74c-4ffb-a1e7-70d5b76356dc None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:13.120727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead395cb-a74c-4ffb-a1e7-70d5b76356dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:13.137204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ead395cb-a74c-4ffb-a1e7-70d5b76356dc None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:13.138386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ead395cb-a74c-4ffb-a1e7-70d5b76356dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:13.204460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 600/1207] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:13.473371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1d6ae-e1d0-4dad-88a8-a9c302068107 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:13.573052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1d6ae-e1d0-4dad-88a8-a9c302068107 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:13.606287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:13.606898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:13.607176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:13.607449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:13.619384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:35:13.624165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:13.625342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:13.626436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 608/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:35:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:13.631141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead395cb-a74c-4ffb-a1e7-70d5b76356dc None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:13.670110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:13.728391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead395cb-a74c-4ffb-a1e7-70d5b76356dc None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:13.760652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:13.761985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:13.762278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:13.762564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:13.763302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:13.763623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:13.765625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:13.773580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 601/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:35:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:13.779400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:13.829545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:13.877307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e753-e7c0-465c-8dd6-e15368de291e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:13.910803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:13.911427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:13.911711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:13.911986 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:13.921733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:13.923165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:13.937945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:13.939036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:13.940373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:13.940373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:13.940373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:13.940373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 609/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:13.945108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:14.041274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:14.044052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839873c-2b7e-4ff8-9398-d0e2d704fd55 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:14.078751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:14.079350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:14.079633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:14.079907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:14.080906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:14.081281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:14.082655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:14.093696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 602/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:35:14.099156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:14.195860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7179d65-7e8a-4d2e-ac20-445d6a1d9a35 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:14.197409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:14.229588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:14.230200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:14.230567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:14.230848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:14.238106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:14.239526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:35:14.251126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:14.252295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:14.253475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 610/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:14.258120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:14.358323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fd9da-d28c-4894-b294-60cb84f33475 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:14.391549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:14.392158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:14.392475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:14.392753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:14.393485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:14.393796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:14.395232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:14.411892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 603/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Aug 22 05:35:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:14.417697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:14.518027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebc153-2c04-41cf-a41c-804ba0dcd4f0 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:14.552958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:14.553568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:14.553853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:14.554133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:14.583554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:14.620180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:14.621606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:14.717507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 611/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:35:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:35:14.723375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:14.742139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:14.820665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc3bde-ecc9-4c3b-a398-7d96cbc376fe None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:14.853332 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:14.853949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:14.854233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:14.854511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:14.864905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:14.867095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:14.880594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:14.881541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:14.882510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:14.882510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:14.882510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:14.882510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 604/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:14.887452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:14.946615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:14.984071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258af109-5660-46e5-86d5-cbdf6fa1868b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:15.015665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:15.016289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:15.016575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:15.016851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:15.017496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:15.017804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:15.019161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:15.032955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 612/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:35:15.038653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:15.107172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:15.136920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0c11-f52b-4a84-a9bc-837219f67b4e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:15.168642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:15.169254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:15.169536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:15.169880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:15.176822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:15.178248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:35:15.189044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:15.195193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:15.196353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 605/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:35:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:15.196977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:15.294241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753c038-bd8f-4683-a74b-4d562b654108 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:15.315878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:15.327479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eb3c1-ba34-4be3-8e26-76742079ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:15.328117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eb3c1-ba34-4be3-8e26-76742079ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:15.328425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eb3c1-ba34-4be3-8e26-76742079ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:15.328705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eb3c1-ba34-4be3-8e26-76742079ecb1 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:15.329398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eb3c1-ba34-4be3-8e26-76742079ecb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:15.329707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eb3c1-ba34-4be3-8e26-76742079ecb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:15.331392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eb3c1-ba34-4be3-8e26-76742079ecb1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:15.342542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 613/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:35:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:35:15.349102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:15.447298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52595ce3-c84b-429f-aa47-a5f58c6be602 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:15.474930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:15.480500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed1741-11f7-48fa-b725-27cb91137fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:15.481090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1741-11f7-48fa-b725-27cb91137fc4 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:15.481369 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1741-11f7-48fa-b725-27cb91137fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:15.481642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed1741-11f7-48fa-b725-27cb91137fc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:15.482355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1741-11f7-48fa-b725-27cb91137fc4 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=908320440dfe4e8783d77b7d385b43fc) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:15.482761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1741-11f7-48fa-b725-27cb91137fc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:15.484231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed1741-11f7-48fa-b725-27cb91137fc4 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:15.489569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 606/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:35:15 2022] GET /identity/v3/role_assignments?user.id=908320440dfe4e8783d77b7d385b43fc&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:35:17.343389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1e60-26fc-48fd-af7d-15e2da3d4a3c None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:17.343894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1e60-26fc-48fd-af7d-15e2da3d4a3c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:17.343998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd1e60-26fc-48fd-af7d-15e2da3d4a3c None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:17.345320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 614/1220] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:17.350332 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c8cf-4599-44d4-8284-baaedecf99a1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:17.350734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c8cf-4599-44d4-8284-baaedecf99a1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:17.350949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c8cf-4599-44d4-8284-baaedecf99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:17.368938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-11c1c8cf-4599-44d4-8284-baaedecf99a1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:17.370194 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-11c1c8cf-4599-44d4-8284-baaedecf99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:17.437741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 607/1221] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:17.712719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd1e60-26fc-48fd-af7d-15e2da3d4a3c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:17.812722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd1e60-26fc-48fd-af7d-15e2da3d4a3c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:17.845919 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:17.846540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:17.846825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:17.847105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] PATH_INFO: `/v3/roles/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:17.856977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:35:17.862232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:17.863344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:17.864455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 615/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:35:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:17.869379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c8cf-4599-44d4-8284-baaedecf99a1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:17.967427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c8cf-4599-44d4-8284-baaedecf99a1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:17.993451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:18.003821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add788-b600-44c9-a4cc-87901159651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:18.004448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add788-b600-44c9-a4cc-87901159651f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:18.004730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add788-b600-44c9-a4cc-87901159651f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:18.005004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05add788-b600-44c9-a4cc-87901159651f None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:18.005665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add788-b600-44c9-a4cc-87901159651f None admin] RBAC: Adding query filter params (name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:18.005970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add788-b600-44c9-a4cc-87901159651f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:18.007335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05add788-b600-44c9-a4cc-87901159651f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:18.014810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 608/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:18.020620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:18.064004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:18.117137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21e78-e83b-45fe-b3a2-7171b2f8683b None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:18.150761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:18.151379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:18.151684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:18.151964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:18.162141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:18.163571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:18.177947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:18.179082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:18.184287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:18.184287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:18.184287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:18.184287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 616/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:18.185156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add788-b600-44c9-a4cc-87901159651f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:18.285169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05add788-b600-44c9-a4cc-87901159651f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:18.319378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:18.319985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:18.320299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:18.320583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:18.321226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:18.321538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:18.322914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:18.334945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 609/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:18.340834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:18.432627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:18.439150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d51079-4f20-4fdb-bd69-74c7f6c9e211 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:18.473619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:18.474226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:18.474511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:18.474785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] PATH_INFO: `/v3/users/placement` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:18.481493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:18.482932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:35:18.493903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:18.495653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:18.496983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 617/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:18.500936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:18.548103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:18.599206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fec0f-ff3b-44cd-bfdf-fe3d9af89c8e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:18.632929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:18.633531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:18.633819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:18.634101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:18.634828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:18.635141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:18.636614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:18.653838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 610/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Aug 22 05:35:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:18.659557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:18.756880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094689c6-5703-4b20-87a0-69ec4b07247e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:18.789256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:18.789871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:18.790154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:18.790433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:18.800632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:18.802008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:18.815881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:18.822165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:18.823071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:18.823071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:18.823071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:18.823071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 618/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:18.823299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:18.923048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ecfed-eb13-4a57-9ad6-5a7dbe8ffbef None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:18.925303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:18.957354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:18.957965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:18.958245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:18.958535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:18.959357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:18.959829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:18.961540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:18.972779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 611/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:35:18.978420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:18.988620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:19.077830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25299cf6-7fc3-4d24-b6d6-ca1648b56af2 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:19.110150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:19.110761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:19.111040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:19.111313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:19.117984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:19.119401 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:35:19.130652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:19.131672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:19.132953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 619/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:35:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:19.137609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:19.231505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88732b-65cf-4877-9c85-bd6e97ac8216 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:19.264739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73960109-f99b-43e5-bf01-297088c26786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:19.265333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73960109-f99b-43e5-bf01-297088c26786 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:19.265610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73960109-f99b-43e5-bf01-297088c26786 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:19.265882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73960109-f99b-43e5-bf01-297088c26786 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:19.266594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73960109-f99b-43e5-bf01-297088c26786 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:19.266870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73960109-f99b-43e5-bf01-297088c26786 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:19.268319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73960109-f99b-43e5-bf01-297088c26786 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:19.280264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 612/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:35:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:19.286517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:19.350659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:19.385140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fbba-1e6d-44ef-ab30-efe183396e04 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:19.417439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd99492-ce2b-4205-9b0b-01448aa1dd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:19.418088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99492-ce2b-4205-9b0b-01448aa1dd6f None admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:19.418370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99492-ce2b-4205-9b0b-01448aa1dd6f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:19.418646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd99492-ce2b-4205-9b0b-01448aa1dd6f None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/908320440dfe4e8783d77b7d385b43fc/roles/61ca3da5b31d4366a080ece9048a5ba8` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:19.433005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd99492-ce2b-4205-9b0b-01448aa1dd6f None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=908320440dfe4e8783d77b7d385b43fc, role_id=61ca3da5b31d4366a080ece9048a5ba8)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:19.434435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd99492-ce2b-4205-9b0b-01448aa1dd6f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:19.571507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 620/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:35:19 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/908320440dfe4e8783d77b7d385b43fc/roles/61ca3da5b31d4366a080ece9048a5ba8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:35:21.486269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355de2a-dea0-4821-8478-06355d3ada31 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:21.486845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355de2a-dea0-4821-8478-06355d3ada31 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:21.486845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355de2a-dea0-4821-8478-06355d3ada31 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:21.488170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 613/1233] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:21.493543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b681-d191-4016-9a55-42595985a47f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:21.493950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b681-d191-4016-9a55-42595985a47f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:21.494104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0b681-d191-4016-9a55-42595985a47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:21.513276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4cd0b681-d191-4016-9a55-42595985a47f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:21.514482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4cd0b681-d191-4016-9a55-42595985a47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:21.580059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 621/1234] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:21.849461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355de2a-dea0-4821-8478-06355d3ada31 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:21.874714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:21.948003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355de2a-dea0-4821-8478-06355d3ada31 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:21.981188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:21.981812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:21.982093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:21.982368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:21.992607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:35:21.997199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:21.998151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:21.999603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 614/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Aug 22 05:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:22.005015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b681-d191-4016-9a55-42595985a47f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:22.049530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:22.100347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0b681-d191-4016-9a55-42595985a47f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:22.133842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:22.134436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:22.134719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:22.134995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:22.135656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] RBAC: Adding query filter params (name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:22.135968 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:22.137365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:22.144933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 622/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Aug 22 05:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:22.150619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:22.234022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:22.249758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ead30-5e4e-4e54-9271-d21dae252f33 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:22.283341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:22.284010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:22.284408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:22.284684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:22.297128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:22.298590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:22.313309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:22.319303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:22.320461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:22.320461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:22.320461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:22.320461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 615/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:22.320749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:22.418468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84281-5768-4455-a1f8-720241b83c8e None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:22.427601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:22.450697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:22.451297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:22.451582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:22.451859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:22.452540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:22.452852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:22.454210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:22.465660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 623/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:35:22.471860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:22.571149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4256e45-b34c-4fab-9e73-aaea70604b7c None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:22.604722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:22.605341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:22.605621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:22.605893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:22.609173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:22.614267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:22.615742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:35:22.626533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:22.627503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:22.628601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 616/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:22.633621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:22.731846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec059399-a0b1-4d63-8f36-fcfaf4d19b38 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:22.766383 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:22.766989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:22.767276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:22.767555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:22.768315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:22.768627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:22.770071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:22.787385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 624/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Aug 22 05:35:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:22.793435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:22.890564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27686-e0c9-4f4b-b5fc-045deb2be798 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:22.922838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:22.923433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:22.923715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:22.923987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:22.983529 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:22.989782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:22.991249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:23.086972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 617/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:35:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:35:23.093161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:23.119932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:23.192804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf10ca-26d4-4cc9-9e26-b21b518ea936 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:23.225507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:23.226126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:23.226408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:23.226683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:23.236155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:23.237564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:23.251880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:23.254668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:23.255865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:23.255865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:23.255865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:23.255865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 625/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:23.258900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:23.352587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:23.358672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b79d3-086a-4844-a8a6-b25831307247 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:23.392337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:23.392867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:23.393147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:23.393419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:23.394056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:23.394358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:23.395714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:23.406550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 618/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:23.412223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:23.493406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:23.514001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271c4e6-40a7-4224-8e3c-1162dacb390d None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:23.546651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:23.547265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:23.547543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:23.547815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:23.554056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:23.555481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:35:23.568215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:23.569344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:23.570424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 626/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:35:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:23.575150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:23.671930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ad68-ee44-4727-b270-35d984204e38 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:23.704174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66de0-929a-4086-a6cc-2ac5e9d62281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:23.704812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66de0-929a-4086-a6cc-2ac5e9d62281 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:23.705094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66de0-929a-4086-a6cc-2ac5e9d62281 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:23.705732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66de0-929a-4086-a6cc-2ac5e9d62281 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:23.706423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66de0-929a-4086-a6cc-2ac5e9d62281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:23.706733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66de0-929a-4086-a6cc-2ac5e9d62281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:23.708158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66de0-929a-4086-a6cc-2ac5e9d62281 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:23.719537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 619/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:35:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:23.725569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:23.822900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ba372-f744-41f1-bbe2-d720d656eda9 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:23.854801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d505ed-cca9-47a0-8a86-95aadca5bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:23.855383 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d505ed-cca9-47a0-8a86-95aadca5bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:23.855661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d505ed-cca9-47a0-8a86-95aadca5bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:23.855936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d505ed-cca9-47a0-8a86-95aadca5bfe1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:23.856677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d505ed-cca9-47a0-8a86-95aadca5bfe1 None admin] RBAC: Adding query filter params (role.id=61ca3da5b31d4366a080ece9048a5ba8, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=908320440dfe4e8783d77b7d385b43fc) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:23.856985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d505ed-cca9-47a0-8a86-95aadca5bfe1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:23.858995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d505ed-cca9-47a0-8a86-95aadca5bfe1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:23.864563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 627/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:35:23 2022] GET /identity/v3/role_assignments?user.id=908320440dfe4e8783d77b7d385b43fc&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=61ca3da5b31d4366a080ece9048a5ba8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:25.816802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153ded-c53a-46b2-b715-bceeaf4a744f None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:25.817330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153ded-c53a-46b2-b715-bceeaf4a744f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:25.817438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153ded-c53a-46b2-b715-bceeaf4a744f None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:25.818868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 620/1247] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:25.824168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc64369-6d50-4b4f-bb66-ac4f4e54647f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:25.824591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc64369-6d50-4b4f-bb66-ac4f4e54647f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:25.824815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc64369-6d50-4b4f-bb66-ac4f4e54647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:25.831889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:25.844645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5cc64369-6d50-4b4f-bb66-ac4f4e54647f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:25.845823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5cc64369-6d50-4b4f-bb66-ac4f4e54647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:25.917282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 628/1248] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:26.187232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153ded-c53a-46b2-b715-bceeaf4a744f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:26.205721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:26.287963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153ded-c53a-46b2-b715-bceeaf4a744f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:26.322415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:26.323078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:26.323359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:26.323629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:26.334509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:35:26.339155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:26.340337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:26.341393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 621/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:35:26.348483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc64369-6d50-4b4f-bb66-ac4f4e54647f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:26.445456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc64369-6d50-4b4f-bb66-ac4f4e54647f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:26.474157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:26.478855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:26.479456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:26.479742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:26.480023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:26.480712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:26.481018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:26.482378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:26.491065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 629/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:26.496965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:26.574240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:26.597149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b5c2c-3f78-4a3c-b2e2-fd8d240a3f4e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:26.630873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:26.631492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:26.631771 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:26.632044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:26.642127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:26.643639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:26.657633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:26.658777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:26.659902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:26.659902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:26.659902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:26.659902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 622/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:26.664953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:26.762047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504f949-5eb4-4d72-893f-c0d6de02bef8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:26.793385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:26.793982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:26.794263 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:26.794538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:26.795703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:26.796005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:26.797387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:26.808594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 630/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:26.814857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:26.910969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7d743-cfb7-4894-a569-e967b7a656ff None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:26.936003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:26.943506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:26.944127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:26.944440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:26.944718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:26.951752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:26.953208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:35:26.964014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:26.965144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:26.966531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 623/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:26.971420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:27.026454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:27.068637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c944c7-13ab-4aee-8595-981c4840bd78 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:27.100988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:27.101582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:27.101860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:27.102133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:27.102852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:27.103157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:27.104598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:27.121432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 631/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Aug 22 05:35:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:27.127327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:27.225958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0057b-4e35-4e20-ac6b-41627209e00b None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:27.258364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:27.259004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:27.259289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:27.259569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:27.315268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:27.327413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:27.328910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:27.424258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 624/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:35:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 22 05:35:27.430179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:27.526754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24352b22-4775-4097-91a9-546a5f472de1 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:27.540212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:27.560319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:27.561059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:27.561287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:27.561558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:27.571096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:27.572557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:27.588183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:27.589941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:27.590876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:27.590876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:27.590876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:27.590876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 632/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:27.595270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:27.678221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:27.690020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d902d-addb-41f9-94bd-c8f21311cdb7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:27.722739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:27.723336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:27.723617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:27.723894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:27.724568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:27.724874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:27.726249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:27.736784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 625/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:27.742609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:27.840995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a712af-aea2-4e99-a03e-cf9cb2edeade None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:27.873499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:27.874118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:27.874397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:27.874671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:27.881075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:27.882505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:35:27.893793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:27.902506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:27.903656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 633/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 22 05:35:27.904237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:27.999506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863929b-bc57-47e1-ac96-9a241415fc1d None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:28.031881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a571f1-4c05-43bb-8c3c-8b7c6b338ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:28.032527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a571f1-4c05-43bb-8c3c-8b7c6b338ae3 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:28.032809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a571f1-4c05-43bb-8c3c-8b7c6b338ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:28.033090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a571f1-4c05-43bb-8c3c-8b7c6b338ae3 None admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:28.033785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a571f1-4c05-43bb-8c3c-8b7c6b338ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:28.034099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a571f1-4c05-43bb-8c3c-8b7c6b338ae3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:28.035548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a571f1-4c05-43bb-8c3c-8b7c6b338ae3 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:28.047629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 626/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:28.053771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:28.079386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:28.152131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79568256-85b1-4767-a5a8-0be801c49704 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:28.186140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55626a71-c3cb-4a6c-b6c4-ae05f588400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:28.186743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55626a71-c3cb-4a6c-b6c4-ae05f588400f None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:28.187027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55626a71-c3cb-4a6c-b6c4-ae05f588400f None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:28.187307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55626a71-c3cb-4a6c-b6c4-ae05f588400f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:28.188031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55626a71-c3cb-4a6c-b6c4-ae05f588400f None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=908320440dfe4e8783d77b7d385b43fc) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:28.188377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55626a71-c3cb-4a6c-b6c4-ae05f588400f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:28.189816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55626a71-c3cb-4a6c-b6c4-ae05f588400f None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:28.195149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 634/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:35:28 2022] GET /identity/v3/role_assignments?user.id=908320440dfe4e8783d77b7d385b43fc&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:30.070474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f70c-adf4-475d-bbfa-82a085d42095 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:30.071008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f70c-adf4-475d-bbfa-82a085d42095 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:30.071008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952f70c-adf4-475d-bbfa-82a085d42095 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:30.072391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 627/1261] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:30.078156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d9f2-c946-46e0-8718-1f4608c2b7a7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:30.078539 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d9f2-c946-46e0-8718-1f4608c2b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:30.078719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296d9f2-c946-46e0-8718-1f4608c2b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:30.097763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c296d9f2-c946-46e0-8718-1f4608c2b7a7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:30.098962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c296d9f2-c946-46e0-8718-1f4608c2b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:30.164499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 635/1262] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:35:30.439214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952f70c-adf4-475d-bbfa-82a085d42095 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:30.450005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:30.539266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952f70c-adf4-475d-bbfa-82a085d42095 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:30.573665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:30.574287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:30.574568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:30.574887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:30.585120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:35:30.589763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:30.590888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:30.592630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 628/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:30.597469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296d9f2-c946-46e0-8718-1f4608c2b7a7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:30.616741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:30.700839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c296d9f2-c946-46e0-8718-1f4608c2b7a7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:30.734571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:30.735176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:30.735461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:30.735737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:30.736431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:30.736744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:30.738105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:30.745924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 636/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:30.751732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:30.817699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:30.850363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489103b-d34c-43f2-95dc-ece4c16c3e3a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:30.884121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:30.884779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:30.885063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:30.885342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:30.894986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:30.896479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:30.911567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:30.912780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:30.913917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:30.913917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:30.913917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:30.913917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 629/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:30.918508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:30.998307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:31.016995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a835e76-6da6-43d8-8059-9990ad6877d8 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:31.050101 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:31.050703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:31.050984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:31.051260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:31.051900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:31.052231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:31.053600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:31.064441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 637/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:31.070096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:31.169934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4cdef3-9eaf-4f79-b5c1-feff5eb1a98a None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:31.189062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:31.203010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:31.203632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:31.203945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:31.204214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:31.211657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:31.213125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:35:31.224561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:31.227545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:31.228795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 630/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:31.231662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:31.332530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6f4d0-2cfb-48aa-9158-6f9e6f914f85 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:31.365981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:31.366611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:31.366895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:31.367171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:31.367904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:31.368225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:31.369673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:31.379145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:31.386973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 638/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Aug 22 05:35:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:31.393374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:31.490161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d97668-fcb5-47b7-bbd2-3d935059bec6 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:31.523202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:31.523823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:31.524105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:31.524406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:31.534456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:31.535890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:31.549358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:31.550501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:31.551474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:31.551474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:31.551474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:31.551474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 631/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:31.556473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:31.665701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4072a-9266-4a67-afc6-593fd2a6bc50 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:31.706494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:31.707476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:31.707941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:31.708396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:31.713492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:31.713492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:31.713492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:31.724016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 639/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:31.729870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:31.762754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:31.832127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd64ab6-78ee-4f96-b539-4e7b3f61679e None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:31.865276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:31.865890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:31.866170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:31.866465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:31.873399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:31.874846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:35:31.885560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:31.886562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:31.887635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 632/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:35:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:31.892578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:31.951378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:31.991231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbe31a-e9bb-4ba1-881c-61145c1daffb None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:32.023601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38189fc-aa6a-4705-888d-a5237ee543dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:32.024305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38189fc-aa6a-4705-888d-a5237ee543dc None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:32.024542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38189fc-aa6a-4705-888d-a5237ee543dc None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:32.024816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38189fc-aa6a-4705-888d-a5237ee543dc None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:32.025506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38189fc-aa6a-4705-888d-a5237ee543dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:32.025816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38189fc-aa6a-4705-888d-a5237ee543dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:32.027238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38189fc-aa6a-4705-888d-a5237ee543dc None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:32.038840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 640/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:35:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:32.045470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:32.135736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:32.144090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dad5be-4730-4e8a-bb30-1d20e0583c6f None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:32.177181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9b374-3a8a-48ea-8801-0e1ff121c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:32.177808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9b374-3a8a-48ea-8801-0e1ff121c7a0 None admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:32.178096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9b374-3a8a-48ea-8801-0e1ff121c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:32.178375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9b374-3a8a-48ea-8801-0e1ff121c7a0 None admin] PATH_INFO: `/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/908320440dfe4e8783d77b7d385b43fc/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:32.180336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9b374-3a8a-48ea-8801-0e1ff121c7a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee73da9fed67459498f499aa2ca135ec, user_id=908320440dfe4e8783d77b7d385b43fc, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:32.183731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b9b374-3a8a-48ea-8801-0e1ff121c7a0 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:32.431446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 633/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Aug 22 05:35:32 2022] PUT /identity/v3/projects/ee73da9fed67459498f499aa2ca135ec/users/908320440dfe4e8783d77b7d385b43fc/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:35:34.308502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c637e3-dbfa-4f79-857e-7ecc29ba2c8f None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:34.309006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c637e3-dbfa-4f79-857e-7ecc29ba2c8f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:34.309105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c637e3-dbfa-4f79-857e-7ecc29ba2c8f None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:34.310902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 641/1274] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:34.315936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0892-21c4-4763-8190-d328ac6644e9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:34.316374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0892-21c4-4763-8190-d328ac6644e9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:34.317619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e0892-21c4-4763-8190-d328ac6644e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:34.335270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-777e0892-21c4-4763-8190-d328ac6644e9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:34.336487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-777e0892-21c4-4763-8190-d328ac6644e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:34.401928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 634/1275] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:34.668565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c637e3-dbfa-4f79-857e-7ecc29ba2c8f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:34.766875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c637e3-dbfa-4f79-857e-7ecc29ba2c8f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:34.783282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:34.799601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:34.800249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:34.800535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:34.800812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:34.810922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 22 05:35:34.815552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:34.820237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:34.821301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 642/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Aug 22 05:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:34.822995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0892-21c4-4763-8190-d328ac6644e9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:34.901415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:34.918541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e0892-21c4-4763-8190-d328ac6644e9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:34.951568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:34.952100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:34.952407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:34.952679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:34.953334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:34.953636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:34.955243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:34.962874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 635/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Aug 22 05:35:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:34.968604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:35.067159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bdd9f-910a-4a39-bd79-1bf296ecd9a7 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:35.100686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:35.101306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:35.101588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:35.101864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:35.112139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:35.113605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:35.127654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:35.129599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:35.130714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:35.130714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:35.130714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:35.130714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 643/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:35.134724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:35.232620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a5d06-8713-42fd-a5c9-092cf2a6cb46 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:35.264746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:35.265345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:35.265625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:35.265922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:35.266614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:35.266922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:35.268308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:35.280252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 636/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:35.286123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:35.318328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:35.385743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7904b-22d3-410c-82ea-5498722c3742 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:35.418391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:35.419003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:35.419282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:35.420139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:35.426929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:35.428379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 22 05:35:35.440257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:35.441368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:35.442732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 644/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:35.447156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:35.451509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:35.544375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf1e13-1c0d-458d-a130-e8747eecd5ca None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:35.577292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:35.577892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:35.578177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:35.578456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:35.579196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:35.579490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:35.581261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:35.598123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 637/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Aug 22 05:35:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:35.603905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:35.690843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:35.700280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a86ba-ad4e-4669-9659-54ff6d656b17 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:35.733931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:35.734532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:35.734890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:35.735115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:35.801057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:35.802438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:35.889473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:35.899310 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 645/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Aug 22 05:35:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 22 05:35:35.905288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:35.965271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:36.005305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ae75c-79af-4ba5-b0f6-f4bf6de1b2c7 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:36.040098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:36.040755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:36.041040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:36.041318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:36.051647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:36.053081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 22 05:35:36.067208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:36.073148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 22 05:35:36.075592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 22 05:35:36.075592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 22 05:35:36.075592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:36.075592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 638/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:36.076453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:36.171641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e49381-cc7d-442f-8737-2c0533f43fd4 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:36.205588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:36.206191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:36.206474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:36.206750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:36.207405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:36.207754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:36.209162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:36.220166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 646/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Aug 22 05:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:35:36.226078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:36.331004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c72d48-88c2-4d91-81ed-def61d4ffec2 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:36.344305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:36.364887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:36.365667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:36.365953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:36.366230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:36.374567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:36.376675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 22 05:35:36.388845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:36.390606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: ERROR keystone.server.flask.application Aug 22 05:35:36.392435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 639/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Aug 22 05:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:36.398839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:36.452829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:36.506188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382b42c-5a4b-4db0-b7b4-d639670305a5 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:36.541595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a07a-e8a8-49de-b7b0-c44218541067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:36.542228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a07a-e8a8-49de-b7b0-c44218541067 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:36.542515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a07a-e8a8-49de-b7b0-c44218541067 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:36.542816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a07a-e8a8-49de-b7b0-c44218541067 None admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:36.543506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a07a-e8a8-49de-b7b0-c44218541067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:36.543819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a07a-e8a8-49de-b7b0-c44218541067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:36.545958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50a07a-e8a8-49de-b7b0-c44218541067 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:36.560641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 647/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Aug 22 05:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:36.567027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:36.673195 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af1f5f-f6d4-4894-9e19-39fe1c971011 None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:36.706644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f131b1-8d3f-4dbd-bd1d-54cd7e2e6222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:36.707247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f131b1-8d3f-4dbd-bd1d-54cd7e2e6222 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:36.707528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f131b1-8d3f-4dbd-bd1d-54cd7e2e6222 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:36.707805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f131b1-8d3f-4dbd-bd1d-54cd7e2e6222 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:36.708557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f131b1-8d3f-4dbd-bd1d-54cd7e2e6222 None admin] RBAC: Adding query filter params (role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1, scope.project.id=ee73da9fed67459498f499aa2ca135ec, user.id=908320440dfe4e8783d77b7d385b43fc) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:36.708867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f131b1-8d3f-4dbd-bd1d-54cd7e2e6222 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:36.710298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f131b1-8d3f-4dbd-bd1d-54cd7e2e6222 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:36.716718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 640/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Aug 22 05:35:36 2022] GET /identity/v3/role_assignments?user.id=908320440dfe4e8783d77b7d385b43fc&scope.project.id=ee73da9fed67459498f499aa2ca135ec&role.id=0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:38.626637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903a590-f7dc-4eaa-8235-5dd5733850ed None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:38.627191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903a590-f7dc-4eaa-8235-5dd5733850ed None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:38.627191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903a590-f7dc-4eaa-8235-5dd5733850ed None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:38.628559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 648/1288] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:38.633872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076a781-b32a-4306-836f-080c9031e4ad None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:38.634343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076a781-b32a-4306-836f-080c9031e4ad None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:38.635450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076a781-b32a-4306-836f-080c9031e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:38.657263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d076a781-b32a-4306-836f-080c9031e4ad None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:38.658487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d076a781-b32a-4306-836f-080c9031e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:38.687245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:38.723544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 641/1289] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:38.986918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903a590-f7dc-4eaa-8235-5dd5733850ed None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:39.089390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903a590-f7dc-4eaa-8235-5dd5733850ed None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:39.099765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:39.121975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:39.123106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:39.123381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:39.123649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:39.124257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:39.125611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:39.134152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:39.135381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:39.136507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 649/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:35:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:39.141840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076a781-b32a-4306-836f-080c9031e4ad None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:39.235339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076a781-b32a-4306-836f-080c9031e4ad None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:39.268597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c3da-3104-4d89-ad1e-28b2e674dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:39.269134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c3da-3104-4d89-ad1e-28b2e674dd1e None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:39.269417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c3da-3104-4d89-ad1e-28b2e674dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:39.269701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c3da-3104-4d89-ad1e-28b2e674dd1e None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:39.270333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c3da-3104-4d89-ad1e-28b2e674dd1e None admin] RBAC: Adding query filter params (name=placement) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:39.270643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c3da-3104-4d89-ad1e-28b2e674dd1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:39.272011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c3da-3104-4d89-ad1e-28b2e674dd1e None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:39.276651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 642/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Aug 22 05:35:39 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:39.282503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:39.381411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9c08c-892d-4f11-8e80-bfad5dc3bb43 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:39.413220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009b490-f860-4bd8-bff2-2f429d38ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:39.413813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b490-f860-4bd8-bff2-2f429d38ab69 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:39.414120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b490-f860-4bd8-bff2-2f429d38ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:39.414393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009b490-f860-4bd8-bff2-2f429d38ab69 None admin] PATH_INFO: `/v3/services` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:39.415021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009b490-f860-4bd8-bff2-2f429d38ab69 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:39.415323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009b490-f860-4bd8-bff2-2f429d38ab69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:39.416772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009b490-f860-4bd8-bff2-2f429d38ab69 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:39.421582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 650/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Aug 22 05:35:39 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:41.291861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8f4f-f06e-4b31-b3c7-6dc172cbdf4e None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:41.292349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8f4f-f06e-4b31-b3c7-6dc172cbdf4e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:41.292470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f8f4f-f06e-4b31-b3c7-6dc172cbdf4e None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:41.293786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 643/1293] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:41.299424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb7e84-af80-4222-ba2c-34d44acc44dd None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:41.303775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb7e84-af80-4222-ba2c-34d44acc44dd None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:41.303775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb7e84-af80-4222-ba2c-34d44acc44dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:41.317569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f8eb7e84-af80-4222-ba2c-34d44acc44dd None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:41.318766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f8eb7e84-af80-4222-ba2c-34d44acc44dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:41.351948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:41.389202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 651/1294] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:41.654893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8f4f-f06e-4b31-b3c7-6dc172cbdf4e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:41.684948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:41.750926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f8f4f-f06e-4b31-b3c7-6dc172cbdf4e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:41.784766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca2bba-d49c-419a-9b1b-1fa042bac5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:41.785360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca2bba-d49c-419a-9b1b-1fa042bac5bb None admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:41.785639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca2bba-d49c-419a-9b1b-1fa042bac5bb None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:41.785911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca2bba-d49c-419a-9b1b-1fa042bac5bb None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:41.786545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca2bba-d49c-419a-9b1b-1fa042bac5bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:41.787911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca2bba-d49c-419a-9b1b-1fa042bac5bb None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:41.855959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 644/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Aug 22 05:35:41 2022] POST /identity/v3/services => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:35:43.768761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd418d-348d-49b8-95c8-33a8f25b8dba None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:43.769296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd418d-348d-49b8-95c8-33a8f25b8dba None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:43.769296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd418d-348d-49b8-95c8-33a8f25b8dba None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:43.770648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 652/1296] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:43.775951 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e538057-6d26-45de-b350-23455dc75aec None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:43.776360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e538057-6d26-45de-b350-23455dc75aec None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:43.776528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e538057-6d26-45de-b350-23455dc75aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:43.794709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5e538057-6d26-45de-b350-23455dc75aec None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:43.795874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5e538057-6d26-45de-b350-23455dc75aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:43.866381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 645/1297] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:43 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 22 05:35:44.134358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd418d-348d-49b8-95c8-33a8f25b8dba None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:44.234214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd418d-348d-49b8-95c8-33a8f25b8dba None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:44.268083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:44.268812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:44.269095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:44.269372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:44.270045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:44.271493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:44.279942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:44.281064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:44.281945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 653/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:35:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:44.287336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e538057-6d26-45de-b350-23455dc75aec None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:44.305795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:44.384125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e538057-6d26-45de-b350-23455dc75aec None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:44.417119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:44.417665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:44.417949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:44.418226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:44.418884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] RBAC: Adding query filter params (name=placement) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:44.419192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:44.420634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:44.425559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 646/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Aug 22 05:35:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:44.431931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:44.464292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:44.530739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695820-b771-48dd-8bfe-d1275c04e0a3 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:44.564245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52925196-e081-4267-8911-2303d5a5d621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:44.564845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925196-e081-4267-8911-2303d5a5d621 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:44.565131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925196-e081-4267-8911-2303d5a5d621 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:44.565413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52925196-e081-4267-8911-2303d5a5d621 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:44.566120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52925196-e081-4267-8911-2303d5a5d621 None admin] RBAC: Adding query filter params (interface=public, service_id=0fb8a7928d0d4f46a6494f97fa9427b5, region_id=RegionOne) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:44.566439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52925196-e081-4267-8911-2303d5a5d621 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:44.567804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52925196-e081-4267-8911-2303d5a5d621 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:44.572686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 654/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Aug 22 05:35:44 2022] GET /identity/v3/endpoints?service_id=0fb8a7928d0d4f46a6494f97fa9427b5&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:44.578636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:44.658584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:44.676087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1012ab4-1a9c-452f-a37d-c6e0f3e775dd None admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:44.709432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ea0ad-9658-4f0b-8771-addcf8e988ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:44.710032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ea0ad-9658-4f0b-8771-addcf8e988ad None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:44.710317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ea0ad-9658-4f0b-8771-addcf8e988ad None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:44.710599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ea0ad-9658-4f0b-8771-addcf8e988ad None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:44.711225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ea0ad-9658-4f0b-8771-addcf8e988ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:44.712612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ea0ad-9658-4f0b-8771-addcf8e988ad None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:44.719336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 647/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Aug 22 05:35:44 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:35:46.609998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d46f-81ae-4e9e-ae40-6b01d56c4e2e None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:46.610524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d46f-81ae-4e9e-ae40-6b01d56c4e2e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:46.610621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e7d46f-81ae-4e9e-ae40-6b01d56c4e2e None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:46.611900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 655/1302] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:35:46.617282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a7c0-0c93-487a-b846-a95547644665 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:46.617707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a7c0-0c93-487a-b846-a95547644665 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:46.617841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7a7c0-0c93-487a-b846-a95547644665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:46.635685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f2a7a7c0-0c93-487a-b846-a95547644665 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:35:46.636964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f2a7a7c0-0c93-487a-b846-a95547644665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:35:46.701932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 648/1303] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:35:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 22 05:35:46.977864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d46f-81ae-4e9e-ae40-6b01d56c4e2e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:47.070110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:47.077145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e7d46f-81ae-4e9e-ae40-6b01d56c4e2e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:47.109663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:47.110281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:47.110565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:47.110837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:47.111569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:47.113223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 22 05:35:47.122869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 22 05:35:47.125272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.get_or_create( Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application with Lock( Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self._enter() Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application return self.creator() Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application created_value = creator( Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: ERROR keystone.server.flask.application Aug 22 05:35:47.126332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 656/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Aug 22 05:35:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 22 05:35:47.130197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7a7c0-0c93-487a-b846-a95547644665 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:47.203830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:47.225472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7a7c0-0c93-487a-b846-a95547644665 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:47.257960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81feda9-8845-49ee-bc89-0a4e8868d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:47.258501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feda9-8845-49ee-bc89-0a4e8868d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:47.258786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feda9-8845-49ee-bc89-0a4e8868d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:47.259064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81feda9-8845-49ee-bc89-0a4e8868d1a1 None admin] PATH_INFO: `/v3/services` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:47.259693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81feda9-8845-49ee-bc89-0a4e8868d1a1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:35:47.260037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81feda9-8845-49ee-bc89-0a4e8868d1a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:47.261438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81feda9-8845-49ee-bc89-0a4e8868d1a1 None admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:47.266909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 649/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Aug 22 05:35:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:35:47.272707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:35:47.371138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1ac0f-f1be-4d40-ab1b-462aa2c9b989 None admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:35:47.404284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f879d0-45b8-4547-851a-8f7ef528c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:35:47.404882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f879d0-45b8-4547-851a-8f7ef528c04c None admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:35:47.405164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f879d0-45b8-4547-851a-8f7ef528c04c None admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:35:47.405486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f879d0-45b8-4547-851a-8f7ef528c04c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:35:47.406147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f879d0-45b8-4547-851a-8f7ef528c04c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:35:47.407586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f879d0-45b8-4547-851a-8f7ef528c04c None admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:35:47.470406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 657/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:35:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:35:57.301161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=30 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:35:57.466558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:39.031157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea6d2-748f-41eb-b911-262bde92c8d8 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:39.032732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea6d2-748f-41eb-b911-262bde92c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:39.033215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea6d2-748f-41eb-b911-262bde92c8d8 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:39.039978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce26f-f159-4fc3-b8a3-323522a3c721 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:39.040904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce26f-f159-4fc3-b8a3-323522a3c721 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:39.041398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cce26f-f159-4fc3-b8a3-323522a3c721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:39.046384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 650/1307] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:41:39 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:39.142849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-61cce26f-f159-4fc3-b8a3-323522a3c721 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:39.145045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-61cce26f-f159-4fc3-b8a3-323522a3c721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:39.401138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 658/1308] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:41:39.730547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a35f-ecf9-4d91-aacb-657070a34de5 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:39.731026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a35f-ecf9-4d91-aacb-657070a34de5 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:39.736121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748a35f-ecf9-4d91-aacb-657070a34de5 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:39.736121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 651/1309] 10.222.0.27 () {54 vars in 965 bytes} [Mon Aug 22 05:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:39.741005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edce8c-286c-4b39-954d-2345737cedcc None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:39.741486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edce8c-286c-4b39-954d-2345737cedcc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:39.741873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edce8c-286c-4b39-954d-2345737cedcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:39.859364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-86edce8c-286c-4b39-954d-2345737cedcc None None] MFA Rules not processed for user `2d46d5905b004073b10e694ab79e7187`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:39.861684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-86edce8c-286c-4b39-954d-2345737cedcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:39.891775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:39.972237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 659/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Aug 22 05:41:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:41:39.981299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a35f-ecf9-4d91-aacb-657070a34de5 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:41:39.983545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1748a35f-ecf9-4d91-aacb-657070a34de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:40.103553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748a35f-ecf9-4d91-aacb-657070a34de5 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:41:40.186266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77811dbb-536b-4b44-95e8-e57abfce6a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:41:40.187246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77811dbb-536b-4b44-95e8-e57abfce6a53 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:40.187758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77811dbb-536b-4b44-95e8-e57abfce6a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:40.188304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77811dbb-536b-4b44-95e8-e57abfce6a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:40.190138 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-77811dbb-536b-4b44-95e8-e57abfce6a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:40.252695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:40.315812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77811dbb-536b-4b44-95e8-e57abfce6a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:41:40.317595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77811dbb-536b-4b44-95e8-e57abfce6a53 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:41:40.337757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 652/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:41:42.557850 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860178ba-22d7-4726-8868-590b28a04408 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:42.558319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860178ba-22d7-4726-8868-590b28a04408 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:42.558422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860178ba-22d7-4726-8868-590b28a04408 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:42.559735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 660/1312] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:42.565572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6f99-d0ab-4ef9-ae38-ea2055d1bb4a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:42.565991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6f99-d0ab-4ef9-ae38-ea2055d1bb4a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:42.566108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6f99-d0ab-4ef9-ae38-ea2055d1bb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:42.634651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a33e6f99-d0ab-4ef9-ae38-ea2055d1bb4a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:42.635832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a33e6f99-d0ab-4ef9-ae38-ea2055d1bb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:42.730458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 653/1313] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:41:43.027327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d11158-9905-48d3-8c22-a9b25abcac1e None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:43.027618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d11158-9905-48d3-8c22-a9b25abcac1e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:43.027898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d11158-9905-48d3-8c22-a9b25abcac1e None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:43.029296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 661/1314] 10.222.0.27 () {54 vars in 965 bytes} [Mon Aug 22 05:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:43.035090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35ca2-a98f-4c8b-9281-7907f9b62ccc None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:43.035384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35ca2-a98f-4c8b-9281-7907f9b62ccc None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:43.035666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e35ca2-a98f-4c8b-9281-7907f9b62ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:43.047204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:43.111422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-30e35ca2-a98f-4c8b-9281-7907f9b62ccc None None] MFA Rules not processed for user `2d46d5905b004073b10e694ab79e7187`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:43.112652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-30e35ca2-a98f-4c8b-9281-7907f9b62ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:43.185235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 654/1315] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Aug 22 05:41:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:41:43.194278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d11158-9905-48d3-8c22-a9b25abcac1e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:41:43.195793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a6d11158-9905-48d3-8c22-a9b25abcac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:43.296809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d11158-9905-48d3-8c22-a9b25abcac1e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:41:43.367277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:43.369761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3ddc4-17be-448a-9db7-7c6f27520f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:41:43.370380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ddc4-17be-448a-9db7-7c6f27520f62 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:43.370659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ddc4-17be-448a-9db7-7c6f27520f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:43.370933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3ddc4-17be-448a-9db7-7c6f27520f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:43.372563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a5d3ddc4-17be-448a-9db7-7c6f27520f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:43.477910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3ddc4-17be-448a-9db7-7c6f27520f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:41:43.479345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3ddc4-17be-448a-9db7-7c6f27520f62 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:41:43.497311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 662/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:41:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:41:46.048140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786d958-453b-4507-9ba1-ad607ecd48fd None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:46.048702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786d958-453b-4507-9ba1-ad607ecd48fd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:46.048702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786d958-453b-4507-9ba1-ad607ecd48fd None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:46.050542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 655/1317] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:46.055868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742829f-2279-412b-9a37-144438e5d0be None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:46.056317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742829f-2279-412b-9a37-144438e5d0be None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:46.056466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742829f-2279-412b-9a37-144438e5d0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:46.121065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e742829f-2279-412b-9a37-144438e5d0be None None] MFA Rules not processed for user `c72da6899dcd4aa896d76de5911a43ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:46.122285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e742829f-2279-412b-9a37-144438e5d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:46.172004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:46.215231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 663/1318] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:41:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:41:46.501194 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786d958-453b-4507-9ba1-ad607ecd48fd None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:41:46.502745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6786d958-453b-4507-9ba1-ad607ecd48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:46.603935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786d958-453b-4507-9ba1-ad607ecd48fd None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:41:46.606738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:46.675209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af97232-9691-4dfd-91d9-6adbe6d5546c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:41:46.675806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97232-9691-4dfd-91d9-6adbe6d5546c service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:46.676089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97232-9691-4dfd-91d9-6adbe6d5546c service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:46.676402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af97232-9691-4dfd-91d9-6adbe6d5546c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:46.677984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2af97232-9691-4dfd-91d9-6adbe6d5546c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:46.783054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af97232-9691-4dfd-91d9-6adbe6d5546c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:41:46.785118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af97232-9691-4dfd-91d9-6adbe6d5546c service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:41:46.802807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 656/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:41:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:41:49.485205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad0d4-8ef0-4f9b-a091-7033e57a26e7 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:49.485737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad0d4-8ef0-4f9b-a091-7033e57a26e7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:49.485863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bad0d4-8ef0-4f9b-a091-7033e57a26e7 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:49.487746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 664/1320] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:49.492878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c8ba-3673-400c-866c-53a2f72abee4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:49.493321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c8ba-3673-400c-866c-53a2f72abee4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:49.493461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547c8ba-3673-400c-866c-53a2f72abee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:49.532507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:49.556524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f547c8ba-3673-400c-866c-53a2f72abee4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:49.557646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f547c8ba-3673-400c-866c-53a2f72abee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:49.652982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 657/1321] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:41:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:41:49.934661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad0d4-8ef0-4f9b-a091-7033e57a26e7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:41:49.936217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-76bad0d4-8ef0-4f9b-a091-7033e57a26e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:50.038389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bad0d4-8ef0-4f9b-a091-7033e57a26e7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:41:50.109125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43a8eb-3003-405e-8e46-a2f1b6002a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:41:50.109731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43a8eb-3003-405e-8e46-a2f1b6002a94 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:50.110014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43a8eb-3003-405e-8e46-a2f1b6002a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:50.110292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43a8eb-3003-405e-8e46-a2f1b6002a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:50.111901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2a43a8eb-3003-405e-8e46-a2f1b6002a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:50.119162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:50.218029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43a8eb-3003-405e-8e46-a2f1b6002a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:41:50.219393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43a8eb-3003-405e-8e46-a2f1b6002a94 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:41:50.236904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 665/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:41:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:41:53.047868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6037fb-3b51-494a-8278-0a84547a50b3 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:53.048416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6037fb-3b51-494a-8278-0a84547a50b3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:53.048416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6037fb-3b51-494a-8278-0a84547a50b3 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:53.049734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 658/1323] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:53.055038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb604-9aeb-4f4c-846a-51099a88b525 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:53.055464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb604-9aeb-4f4c-846a-51099a88b525 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:53.055597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fb604-9aeb-4f4c-846a-51099a88b525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:53.121190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-628fb604-9aeb-4f4c-846a-51099a88b525 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:53.122398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-628fb604-9aeb-4f4c-846a-51099a88b525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:53.178443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:53.217616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 666/1324] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:41:53.496975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6037fb-3b51-494a-8278-0a84547a50b3 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:41:53.498600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2e6037fb-3b51-494a-8278-0a84547a50b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:53.600816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6037fb-3b51-494a-8278-0a84547a50b3 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:41:53.613016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:53.672833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0c874-271f-4bb8-84ca-4748d982c54d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:41:53.673432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c874-271f-4bb8-84ca-4748d982c54d service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:53.674320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c874-271f-4bb8-84ca-4748d982c54d service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:53.674597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0c874-271f-4bb8-84ca-4748d982c54d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:53.676174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a8c0c874-271f-4bb8-84ca-4748d982c54d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:53.779778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0c874-271f-4bb8-84ca-4748d982c54d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:41:53.781142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0c874-271f-4bb8-84ca-4748d982c54d service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:41:53.799781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 659/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:41:55.781081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbf74d-a9fb-4171-b3c7-ec5797829534 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:55.781595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbf74d-a9fb-4171-b3c7-ec5797829534 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:55.781595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbf74d-a9fb-4171-b3c7-ec5797829534 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:55.783643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 667/1326] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:55.788745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267216d0-0d75-4038-ac6a-f98abd170946 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:55.789172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267216d0-0d75-4038-ac6a-f98abd170946 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:55.789427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267216d0-0d75-4038-ac6a-f98abd170946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:55.836184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:55.854323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-267216d0-0d75-4038-ac6a-f98abd170946 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:55.855580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-267216d0-0d75-4038-ac6a-f98abd170946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:55.950942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 660/1327] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:41:56.238197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbf74d-a9fb-4171-b3c7-ec5797829534 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:41:56.239827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e3dbf74d-a9fb-4171-b3c7-ec5797829534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:56.344655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbf74d-a9fb-4171-b3c7-ec5797829534 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:41:56.429081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69857590-35b9-4a1d-8d73-d1d444eac770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:41:56.429691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857590-35b9-4a1d-8d73-d1d444eac770 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:56.429969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857590-35b9-4a1d-8d73-d1d444eac770 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:56.430243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69857590-35b9-4a1d-8d73-d1d444eac770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:56.431830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-69857590-35b9-4a1d-8d73-d1d444eac770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:56.448805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:56.540239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69857590-35b9-4a1d-8d73-d1d444eac770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:41:56.541686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69857590-35b9-4a1d-8d73-d1d444eac770 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:41:56.559410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 668/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:41:58.521759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7007-d7c9-42ae-a286-1d76631ae225 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:58.522236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7007-d7c9-42ae-a286-1d76631ae225 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:58.522328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d7007-d7c9-42ae-a286-1d76631ae225 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:58.523661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 661/1329] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:41:58.529127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f9f2-5460-404d-82f2-9dda0e75770c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:58.529594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f9f2-5460-404d-82f2-9dda0e75770c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:58.529809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0f9f2-5460-404d-82f2-9dda0e75770c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:58.601143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-78e0f9f2-5460-404d-82f2-9dda0e75770c None None] MFA Rules not processed for user `c72da6899dcd4aa896d76de5911a43ef`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:41:58.602361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-78e0f9f2-5460-404d-82f2-9dda0e75770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:58.665137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:58.696867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 669/1330] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:41:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:41:58.978695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d7007-d7c9-42ae-a286-1d76631ae225 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:41:58.980250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-182d7007-d7c9-42ae-a286-1d76631ae225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:59.090444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d7007-d7c9-42ae-a286-1d76631ae225 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:41:59.109991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:41:59.161752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c4ec-1a78-432e-980f-fac5e738f0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:41:59.162354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c4ec-1a78-432e-980f-fac5e738f0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:41:59.162632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c4ec-1a78-432e-980f-fac5e738f0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:41:59.162927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c4ec-1a78-432e-980f-fac5e738f0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:41:59.164585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7f02c4ec-1a78-432e-980f-fac5e738f0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:41:59.272895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02c4ec-1a78-432e-980f-fac5e738f0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:41:59.274273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02c4ec-1a78-432e-980f-fac5e738f0d1 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:41:59.293444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 662/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:41:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:01.586126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d973-ded8-47fe-9c5b-402756f4c93b None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:01.586914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d973-ded8-47fe-9c5b-402756f4c93b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:01.586914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731d973-ded8-47fe-9c5b-402756f4c93b None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:01.588244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 670/1332] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:01.593507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13631d3e-69d7-4311-855c-cde2f30e8517 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:01.593944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13631d3e-69d7-4311-855c-cde2f30e8517 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:01.594043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13631d3e-69d7-4311-855c-cde2f30e8517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:01.656390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:01.658799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-13631d3e-69d7-4311-855c-cde2f30e8517 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:01.659995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-13631d3e-69d7-4311-855c-cde2f30e8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:01.753537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 663/1333] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:02.033923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d973-ded8-47fe-9c5b-402756f4c93b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:02.035464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6731d973-ded8-47fe-9c5b-402756f4c93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:02.137028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731d973-ded8-47fe-9c5b-402756f4c93b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:02.208198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913ed46-d009-4f99-9893-b469f1379e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:02.208822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913ed46-d009-4f99-9893-b469f1379e26 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:02.209106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913ed46-d009-4f99-9893-b469f1379e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:02.209385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913ed46-d009-4f99-9893-b469f1379e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:02.210966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5913ed46-d009-4f99-9893-b469f1379e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:02.237735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:02.320724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913ed46-d009-4f99-9893-b469f1379e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:02.322160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5913ed46-d009-4f99-9893-b469f1379e26 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:02.340837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 671/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:04.286560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a2de-9f36-4ed7-8732-b830a11520de None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:04.287163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a2de-9f36-4ed7-8732-b830a11520de None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:04.287163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a2de-9f36-4ed7-8732-b830a11520de None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:04.288638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 664/1335] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:04.293683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1f4aa-8ea4-46a0-aee7-209573cff4c1 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:04.294095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1f4aa-8ea4-46a0-aee7-209573cff4c1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:04.294264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1f4aa-8ea4-46a0-aee7-209573cff4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:04.358361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e2b1f4aa-8ea4-46a0-aee7-209573cff4c1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:04.359554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e2b1f4aa-8ea4-46a0-aee7-209573cff4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:04.432101 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:04.455118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 672/1336] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:04.734982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a2de-9f36-4ed7-8732-b830a11520de None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:04.737096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9678a2de-9f36-4ed7-8732-b830a11520de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:04.837634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a2de-9f36-4ed7-8732-b830a11520de None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:04.866825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:04.910867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e0f22-14ae-4772-a65c-2329a807c7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:04.911464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0f22-14ae-4772-a65c-2329a807c7be service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:04.911747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0f22-14ae-4772-a65c-2329a807c7be service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:04.912021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e0f22-14ae-4772-a65c-2329a807c7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:04.913637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-807e0f22-14ae-4772-a65c-2329a807c7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:05.018409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0f22-14ae-4772-a65c-2329a807c7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:05.019774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e0f22-14ae-4772-a65c-2329a807c7be service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:05.037427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 665/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:07.447449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef287e4-41ee-40ee-b602-d64645363321 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:07.447992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef287e4-41ee-40ee-b602-d64645363321 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:07.448089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef287e4-41ee-40ee-b602-d64645363321 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:07.449408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 673/1338] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:07.455035 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9e823-8310-425a-931a-8b6291322a87 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:07.455457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9e823-8310-425a-931a-8b6291322a87 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:07.455589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9e823-8310-425a-931a-8b6291322a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:07.519040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-69e9e823-8310-425a-931a-8b6291322a87 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:07.520259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-69e9e823-8310-425a-931a-8b6291322a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:07.528072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:07.616619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 666/1339] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:07.897855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef287e4-41ee-40ee-b602-d64645363321 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:07.899375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2ef287e4-41ee-40ee-b602-d64645363321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:08.000842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef287e4-41ee-40ee-b602-d64645363321 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:08.070841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb29d2-261f-499a-a24b-a7ed1b08fc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:08.071437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb29d2-261f-499a-a24b-a7ed1b08fc52 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:08.071716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb29d2-261f-499a-a24b-a7ed1b08fc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:08.072041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb29d2-261f-499a-a24b-a7ed1b08fc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:08.073634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-12eb29d2-261f-499a-a24b-a7ed1b08fc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:08.107984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:08.179508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb29d2-261f-499a-a24b-a7ed1b08fc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:08.180906 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb29d2-261f-499a-a24b-a7ed1b08fc52 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:08.199658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 674/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:12.505311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651873d-e588-48a0-9c16-53c62e004a8d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:12.505848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651873d-e588-48a0-9c16-53c62e004a8d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:12.505848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651873d-e588-48a0-9c16-53c62e004a8d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:12.507219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 667/1341] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:42:12.512650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0633-adb0-460b-a988-b7184d2be754 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:12.513093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0633-adb0-460b-a988-b7184d2be754 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:12.513341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b0633-adb0-460b-a988-b7184d2be754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:12.578607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-1c3b0633-adb0-460b-a988-b7184d2be754 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:12.579838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1c3b0633-adb0-460b-a988-b7184d2be754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:12.667679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:12.679728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 675/1342] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:12.963285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651873d-e588-48a0-9c16-53c62e004a8d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:12.964865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0651873d-e588-48a0-9c16-53c62e004a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:13.068878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651873d-e588-48a0-9c16-53c62e004a8d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:13.106499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:13.142718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce910-da2e-4b02-8e48-577ca95e40a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:13.143811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce910-da2e-4b02-8e48-577ca95e40a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:13.144094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce910-da2e-4b02-8e48-577ca95e40a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:13.144471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce910-da2e-4b02-8e48-577ca95e40a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:13.146061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-849ce910-da2e-4b02-8e48-577ca95e40a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:13.252751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce910-da2e-4b02-8e48-577ca95e40a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:13.254109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce910-da2e-4b02-8e48-577ca95e40a1 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:13.272791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 668/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:16.138740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899417-2fb9-4aa2-93e9-d33d063a2c06 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:16.139263 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899417-2fb9-4aa2-93e9-d33d063a2c06 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:16.139378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899417-2fb9-4aa2-93e9-d33d063a2c06 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:16.140695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 676/1344] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:16.146401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804e7b-5df6-45a5-a9cf-0a7f864cb814 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:16.146788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804e7b-5df6-45a5-a9cf-0a7f864cb814 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:16.146955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804e7b-5df6-45a5-a9cf-0a7f864cb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:16.210874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-27804e7b-5df6-45a5-a9cf-0a7f864cb814 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:16.212257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-27804e7b-5df6-45a5-a9cf-0a7f864cb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:16.229833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:16.308054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 669/1345] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:16.589989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899417-2fb9-4aa2-93e9-d33d063a2c06 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:16.591657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a2899417-2fb9-4aa2-93e9-d33d063a2c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:16.696353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899417-2fb9-4aa2-93e9-d33d063a2c06 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:16.770455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2aa502-e5be-4392-9614-4f1def0af5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:16.771105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa502-e5be-4392-9614-4f1def0af5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:16.771452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa502-e5be-4392-9614-4f1def0af5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:16.771822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2aa502-e5be-4392-9614-4f1def0af5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:16.773570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2e2aa502-e5be-4392-9614-4f1def0af5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:16.818733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:16.887961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aa502-e5be-4392-9614-4f1def0af5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:16.889460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2aa502-e5be-4392-9614-4f1def0af5e8 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:16.910414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 677/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:21.225333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde649-4bbc-4032-b219-1cfe8f3db383 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:21.225882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde649-4bbc-4032-b219-1cfe8f3db383 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:21.225882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde649-4bbc-4032-b219-1cfe8f3db383 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:21.227251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 670/1347] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:42:21.232651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855b6c1-dd27-4c3c-92da-61fcdc1352a8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:21.233134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855b6c1-dd27-4c3c-92da-61fcdc1352a8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:21.233225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855b6c1-dd27-4c3c-92da-61fcdc1352a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:21.306762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-1855b6c1-dd27-4c3c-92da-61fcdc1352a8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:21.308011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1855b6c1-dd27-4c3c-92da-61fcdc1352a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:21.406306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:21.409512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 678/1348] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:21.693041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cde649-4bbc-4032-b219-1cfe8f3db383 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:21.694642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c4cde649-4bbc-4032-b219-1cfe8f3db383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:21.794310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cde649-4bbc-4032-b219-1cfe8f3db383 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:21.839409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:21.864620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e885c3-a40a-49a3-95af-2f4966c65cb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:21.865215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e885c3-a40a-49a3-95af-2f4966c65cb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:21.865497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e885c3-a40a-49a3-95af-2f4966c65cb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:21.865780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e885c3-a40a-49a3-95af-2f4966c65cb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:21.867354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b3e885c3-a40a-49a3-95af-2f4966c65cb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:21.976511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e885c3-a40a-49a3-95af-2f4966c65cb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:21.977873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e885c3-a40a-49a3-95af-2f4966c65cb6 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:21.995773 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 671/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:26.888431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d907bf-4e72-4d71-9da7-c76f48076962 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:26.889346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d907bf-4e72-4d71-9da7-c76f48076962 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:26.889845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d907bf-4e72-4d71-9da7-c76f48076962 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:26.891486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 679/1350] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:26.897344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e7a1a-fe2f-40ea-ae6f-3aeec3981bbf None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:26.898175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e7a1a-fe2f-40ea-ae6f-3aeec3981bbf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:26.898667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e7a1a-fe2f-40ea-ae6f-3aeec3981bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:27.036676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c84e7a1a-fe2f-40ea-ae6f-3aeec3981bbf None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:27.037851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c84e7a1a-fe2f-40ea-ae6f-3aeec3981bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:27.056742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:27.168704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 672/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:42:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:31.277462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eff54-31dc-4528-9a77-f5a797966914 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:31.278003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eff54-31dc-4528-9a77-f5a797966914 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:31.278003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eff54-31dc-4528-9a77-f5a797966914 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:31.279579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 680/1352] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:31.288123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9511d-d660-4995-907f-dedb2292ac74 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:31.291165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9511d-d660-4995-907f-dedb2292ac74 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:31.292157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e9511d-d660-4995-907f-dedb2292ac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:31.368624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f6e9511d-d660-4995-907f-dedb2292ac74 None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:31.369805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f6e9511d-d660-4995-907f-dedb2292ac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:31.444696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:31.481165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 673/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:42:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:32.965033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bb4c6-e0e3-4895-88bb-f5e945bbf4a0 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:32.965623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bb4c6-e0e3-4895-88bb-f5e945bbf4a0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:32.965623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bb4c6-e0e3-4895-88bb-f5e945bbf4a0 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:32.966945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 681/1354] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:32.971961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b819931-fe64-4fdb-81b6-7f51f2b7737f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:32.972424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b819931-fe64-4fdb-81b6-7f51f2b7737f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:32.972583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b819931-fe64-4fdb-81b6-7f51f2b7737f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:33.049203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4b819931-fe64-4fdb-81b6-7f51f2b7737f None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:33.050330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4b819931-fe64-4fdb-81b6-7f51f2b7737f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:33.156173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 674/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:42:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:36.461332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae83e1-bb21-4c7c-9e84-c842a77d0ae6 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:36.462219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae83e1-bb21-4c7c-9e84-c842a77d0ae6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:36.462219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae83e1-bb21-4c7c-9e84-c842a77d0ae6 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:36.463520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 682/1356] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:36.468665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7b2bf-42d8-4745-8eed-b7bae410c368 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:36.469099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7b2bf-42d8-4745-8eed-b7bae410c368 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:36.469281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7b2bf-42d8-4745-8eed-b7bae410c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:36.514068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:36.544713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-42c7b2bf-42d8-4745-8eed-b7bae410c368 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:36.545821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-42c7b2bf-42d8-4745-8eed-b7bae410c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:36.666991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 675/1357] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:36.968122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7c8a-ae2d-472a-b80e-0a2a05b46488 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:36.968672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7c8a-ae2d-472a-b80e-0a2a05b46488 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:36.969103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7c8a-ae2d-472a-b80e-0a2a05b46488 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:36.971857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 683/1358] 10.222.0.27 () {54 vars in 962 bytes} [Mon Aug 22 05:42:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:36.979280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47000-f0d5-4f65-acd6-957b20d4bc9d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:36.979280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47000-f0d5-4f65-acd6-957b20d4bc9d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:36.979712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f47000-f0d5-4f65-acd6-957b20d4bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:37.072415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e4f47000-f0d5-4f65-acd6-957b20d4bc9d None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:37.073620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e4f47000-f0d5-4f65-acd6-957b20d4bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:37.129691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:37.201403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 676/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Aug 22 05:42:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:37.210009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7c8a-ae2d-472a-b80e-0a2a05b46488 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:37.212153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e29d7c8a-ae2d-472a-b80e-0a2a05b46488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:37.359316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7c8a-ae2d-472a-b80e-0a2a05b46488 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:37.437813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:37.479069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b22fb-7855-4b90-b549-05ecdbe90a38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:37.479944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b22fb-7855-4b90-b549-05ecdbe90a38 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:37.480377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b22fb-7855-4b90-b549-05ecdbe90a38 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:37.480830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b22fb-7855-4b90-b549-05ecdbe90a38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:37.482746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ae9b22fb-7855-4b90-b549-05ecdbe90a38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:37.574327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b22fb-7855-4b90-b549-05ecdbe90a38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:37.575909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b22fb-7855-4b90-b549-05ecdbe90a38 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:37.594191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 684/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:39.704687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c232b1-176d-4b95-b29b-62a62ce9834d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:39.704687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c232b1-176d-4b95-b29b-62a62ce9834d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:39.705490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c232b1-176d-4b95-b29b-62a62ce9834d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:39.708607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 677/1361] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:39.712117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e8d2-c130-4d33-b7a2-87169781b44e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:39.712706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e8d2-c130-4d33-b7a2-87169781b44e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:39.712706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6e8d2-c130-4d33-b7a2-87169781b44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:39.786595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4ed6e8d2-c130-4d33-b7a2-87169781b44e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:39.787804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4ed6e8d2-c130-4d33-b7a2-87169781b44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:39.831236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:39.894985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 685/1362] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:40.205625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c232b1-176d-4b95-b29b-62a62ce9834d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:40.212815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-28c232b1-176d-4b95-b29b-62a62ce9834d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:40.388432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c232b1-176d-4b95-b29b-62a62ce9834d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:40.398763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:40.505147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3739f1-6071-42e1-afa7-b9e2a53144a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:40.505667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3739f1-6071-42e1-afa7-b9e2a53144a9 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:40.505953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3739f1-6071-42e1-afa7-b9e2a53144a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:40.506233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3739f1-6071-42e1-afa7-b9e2a53144a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:40.507841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6d3739f1-6071-42e1-afa7-b9e2a53144a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:40.609549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3739f1-6071-42e1-afa7-b9e2a53144a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:40.611844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3739f1-6071-42e1-afa7-b9e2a53144a9 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:40.631489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 678/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:42.970880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f9b3-c5c4-42df-b1de-e64047e1a4c1 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:42.971415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f9b3-c5c4-42df-b1de-e64047e1a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:42.971685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562f9b3-c5c4-42df-b1de-e64047e1a4c1 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:42.973189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 686/1364] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:42.978638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0804d-a526-4320-b41d-04dfd7f62310 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:42.979123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0804d-a526-4320-b41d-04dfd7f62310 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:42.979432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0804d-a526-4320-b41d-04dfd7f62310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:42.995569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:43.049015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-69f0804d-a526-4320-b41d-04dfd7f62310 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:43.050402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-69f0804d-a526-4320-b41d-04dfd7f62310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:43.160487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 679/1365] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:43.447084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d44b-7f76-4760-b290-1819341e9cbf None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:43.447536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d44b-7f76-4760-b290-1819341e9cbf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:43.447922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5d44b-7f76-4760-b290-1819341e9cbf None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:43.449708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 687/1366] 10.222.0.27 () {54 vars in 962 bytes} [Mon Aug 22 05:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:43.455730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988fde6-6a95-4cfd-9d0b-e784d52e3ca9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:43.456025 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988fde6-6a95-4cfd-9d0b-e784d52e3ca9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:43.460599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988fde6-6a95-4cfd-9d0b-e784d52e3ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:43.535736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2988fde6-6a95-4cfd-9d0b-e784d52e3ca9 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:43.537128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2988fde6-6a95-4cfd-9d0b-e784d52e3ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:43.574185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:43.659052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 680/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Aug 22 05:42:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:43.666955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d44b-7f76-4760-b290-1819341e9cbf None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:43.668648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8bd5d44b-7f76-4760-b290-1819341e9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:43.822516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5d44b-7f76-4760-b290-1819341e9cbf None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:43.844881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:43.940601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc67ee-0788-4166-9e83-098529109162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:43.941324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc67ee-0788-4166-9e83-098529109162 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:43.941614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc67ee-0788-4166-9e83-098529109162 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:43.941890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc67ee-0788-4166-9e83-098529109162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:43.943465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f2cc67ee-0788-4166-9e83-098529109162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:44.045911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc67ee-0788-4166-9e83-098529109162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:44.049022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc67ee-0788-4166-9e83-098529109162 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:44.068813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 688/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:44.592342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5805-162f-454e-9a13-f8b81237697d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:44.592936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5805-162f-454e-9a13-f8b81237697d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:44.592936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba5805-162f-454e-9a13-f8b81237697d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:44.594931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 681/1369] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:44.600042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77732-b6ae-464c-ac2d-0ed91c432c50 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:44.600364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77732-b6ae-464c-ac2d-0ed91c432c50 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:44.600649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b77732-b6ae-464c-ac2d-0ed91c432c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:44.633081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:44.670109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-55b77732-b6ae-464c-ac2d-0ed91c432c50 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:44.671495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-55b77732-b6ae-464c-ac2d-0ed91c432c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:44.775388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 689/1370] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:42:45.364962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0da5c1-0f1b-4a25-9269-c4ef3b16490d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:45.364962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0da5c1-0f1b-4a25-9269-c4ef3b16490d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:45.364962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0da5c1-0f1b-4a25-9269-c4ef3b16490d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:45.368397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 682/1371] 10.222.0.27 () {54 vars in 964 bytes} [Mon Aug 22 05:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:45.371494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4caa6-fdfb-4f31-8d48-d4d944be66ab None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:45.371978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4caa6-fdfb-4f31-8d48-d4d944be66ab None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:45.372182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4caa6-fdfb-4f31-8d48-d4d944be66ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:45.450632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-7bb4caa6-fdfb-4f31-8d48-d4d944be66ab None None] MFA Rules not processed for user `a1af7582d3e94be1815574887e988e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:45.451977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7bb4caa6-fdfb-4f31-8d48-d4d944be66ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:45.501430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:45.533311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 690/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Aug 22 05:42:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:42:45.541284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0da5c1-0f1b-4a25-9269-c4ef3b16490d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:45.543000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-be0da5c1-0f1b-4a25-9269-c4ef3b16490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:45.649696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0da5c1-0f1b-4a25-9269-c4ef3b16490d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:45.691069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:45.729818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c008546-908c-4f94-bed0-188b2e0bc592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:45.730512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008546-908c-4f94-bed0-188b2e0bc592 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:45.730873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008546-908c-4f94-bed0-188b2e0bc592 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:45.731229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c008546-908c-4f94-bed0-188b2e0bc592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:45.733054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2c008546-908c-4f94-bed0-188b2e0bc592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:45.857481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c008546-908c-4f94-bed0-188b2e0bc592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:45.859339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c008546-908c-4f94-bed0-188b2e0bc592 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:45.882671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 683/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:46.187465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92de63-baf9-4958-be17-b6e77ad456f9 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:46.187657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92de63-baf9-4958-be17-b6e77ad456f9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:46.188483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92de63-baf9-4958-be17-b6e77ad456f9 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:46.189831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 691/1374] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:46.194997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cea7fc-02de-4545-a494-fc48345504dd None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:46.195292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cea7fc-02de-4545-a494-fc48345504dd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:46.195575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cea7fc-02de-4545-a494-fc48345504dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:46.260838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-45cea7fc-02de-4545-a494-fc48345504dd None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:46.262199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-45cea7fc-02de-4545-a494-fc48345504dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:46.282691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:46.360123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 684/1375] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:46.651247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92de63-baf9-4958-be17-b6e77ad456f9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:46.652838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3c92de63-baf9-4958-be17-b6e77ad456f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:46.795393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92de63-baf9-4958-be17-b6e77ad456f9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:46.847256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:46.908256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b2346-f7c5-4081-a19e-ffe0c5e0d786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:46.908871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b2346-f7c5-4081-a19e-ffe0c5e0d786 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:46.909152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b2346-f7c5-4081-a19e-ffe0c5e0d786 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:46.909425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b2346-f7c5-4081-a19e-ffe0c5e0d786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:46.911021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f55b2346-f7c5-4081-a19e-ffe0c5e0d786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:46.999730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b2346-f7c5-4081-a19e-ffe0c5e0d786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:47.001469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b2346-f7c5-4081-a19e-ffe0c5e0d786 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:47.018900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 692/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:49.066790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b471ac-8c1c-4213-9850-25d4ba05dac7 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:49.067330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b471ac-8c1c-4213-9850-25d4ba05dac7 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:49.067330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b471ac-8c1c-4213-9850-25d4ba05dac7 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:49.068720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 685/1377] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:49.074369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0b64-c007-4c6a-ae9b-2d94d33927cb None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:49.075157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0b64-c007-4c6a-ae9b-2d94d33927cb None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:49.075573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e0b64-c007-4c6a-ae9b-2d94d33927cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:49.157637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-112e0b64-c007-4c6a-ae9b-2d94d33927cb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:49.158752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-112e0b64-c007-4c6a-ae9b-2d94d33927cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:49.165330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:49.255483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 693/1378] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:49.554969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b471ac-8c1c-4213-9850-25d4ba05dac7 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:49.557236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-00b471ac-8c1c-4213-9850-25d4ba05dac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:49.728428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b471ac-8c1c-4213-9850-25d4ba05dac7 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:49.732593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:49.845705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e2c38-241b-4400-b261-826b80844f5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:49.847017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2c38-241b-4400-b261-826b80844f5e service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:49.847017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2c38-241b-4400-b261-826b80844f5e service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:49.847367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e2c38-241b-4400-b261-826b80844f5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:49.849088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-274e2c38-241b-4400-b261-826b80844f5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:49.944038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2c38-241b-4400-b261-826b80844f5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:49.945817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e2c38-241b-4400-b261-826b80844f5e service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:49.965170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 686/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:51.997375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d7bf-82e5-40ed-9663-9e89099fa351 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:51.997934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d7bf-82e5-40ed-9663-9e89099fa351 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:51.997934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4d7bf-82e5-40ed-9663-9e89099fa351 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:51.999464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 694/1380] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:52.004631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615512-e0ec-4a15-b5e0-0c9fbbcc1579 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:52.005042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615512-e0ec-4a15-b5e0-0c9fbbcc1579 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:52.005225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5615512-e0ec-4a15-b5e0-0c9fbbcc1579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:52.017102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:52.073499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c5615512-e0ec-4a15-b5e0-0c9fbbcc1579 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:52.074626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c5615512-e0ec-4a15-b5e0-0c9fbbcc1579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:52.177413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 687/1381] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:42:52.468086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d7bf-82e5-40ed-9663-9e89099fa351 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:52.470341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6df4d7bf-82e5-40ed-9663-9e89099fa351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:52.621604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:52.635146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4d7bf-82e5-40ed-9663-9e89099fa351 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:52.754170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f4343c-f5bb-43c7-a5fe-8029bf460253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:52.754690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4343c-f5bb-43c7-a5fe-8029bf460253 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:52.754972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4343c-f5bb-43c7-a5fe-8029bf460253 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:52.755255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f4343c-f5bb-43c7-a5fe-8029bf460253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:52.756894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-06f4343c-f5bb-43c7-a5fe-8029bf460253 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:52.862075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4343c-f5bb-43c7-a5fe-8029bf460253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:52.863729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f4343c-f5bb-43c7-a5fe-8029bf460253 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:52.874039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:52.883266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 695/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:54.998953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b818c-c752-4677-924c-6829a69f12db None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:54.999509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b818c-c752-4677-924c-6829a69f12db None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:54.999509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b818c-c752-4677-924c-6829a69f12db None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:55.001103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 688/1383] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:42:55.006628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbb34-f298-4755-87b4-23749f8c742a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:55.007087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbb34-f298-4755-87b4-23749f8c742a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:55.007220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fbb34-f298-4755-87b4-23749f8c742a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:55.076840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ae9fbb34-f298-4755-87b4-23749f8c742a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:55.078557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ae9fbb34-f298-4755-87b4-23749f8c742a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:55.183771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 696/1384] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:55.485408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b818c-c752-4677-924c-6829a69f12db None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:55.487810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-738b818c-c752-4677-924c-6829a69f12db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:55.595198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:55.657407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b818c-c752-4677-924c-6829a69f12db None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:55.775234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72ca21-026a-4b72-bb99-dc0d77507a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:55.776047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72ca21-026a-4b72-bb99-dc0d77507a27 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:55.776510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72ca21-026a-4b72-bb99-dc0d77507a27 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:55.777238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72ca21-026a-4b72-bb99-dc0d77507a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:55.779739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6b72ca21-026a-4b72-bb99-dc0d77507a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:55.852329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:55.903761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72ca21-026a-4b72-bb99-dc0d77507a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:55.905400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72ca21-026a-4b72-bb99-dc0d77507a27 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:55.923462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 689/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:42:58.063944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6ee0c-c7dc-4dd5-bd98-36d9b5f05119 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:58.064507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6ee0c-c7dc-4dd5-bd98-36d9b5f05119 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:58.064625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6ee0c-c7dc-4dd5-bd98-36d9b5f05119 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:58.065940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 697/1386] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:42:58.072103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b6e6b-d819-421c-b344-beb6134a5d68 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:58.072578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b6e6b-d819-421c-b344-beb6134a5d68 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:58.072683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b6e6b-d819-421c-b344-beb6134a5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:58.149423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-eb5b6e6b-d819-421c-b344-beb6134a5d68 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:42:58.150641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-eb5b6e6b-d819-421c-b344-beb6134a5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:58.251129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 690/1387] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:42:58.614705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6ee0c-c7dc-4dd5-bd98-36d9b5f05119 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:42:58.616870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d1b6ee0c-c7dc-4dd5-bd98-36d9b5f05119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:58.710768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:58.785002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6ee0c-c7dc-4dd5-bd98-36d9b5f05119 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:42:58.912824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035508c-a337-4eda-86f9-af3668f22201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:42:58.913441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035508c-a337-4eda-86f9-af3668f22201 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:42:58.913726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035508c-a337-4eda-86f9-af3668f22201 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:42:58.914003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035508c-a337-4eda-86f9-af3668f22201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:42:58.915600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7035508c-a337-4eda-86f9-af3668f22201 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:42:58.953706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:42:59.006464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035508c-a337-4eda-86f9-af3668f22201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:42:59.009200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7035508c-a337-4eda-86f9-af3668f22201 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:42:59.028264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 698/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:01.058167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351e33-a852-4004-96c3-3da4604ec0fd None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.058703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351e33-a852-4004-96c3-3da4604ec0fd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.058703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1351e33-a852-4004-96c3-3da4604ec0fd None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.060230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 691/1389] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:01.065904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.066344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.066441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22be117-ed34-4c63-aa15-ab71a064bd3c None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.066540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.066630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22be117-ed34-4c63-aa15-ab71a064bd3c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.066728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22be117-ed34-4c63-aa15-ab71a064bd3c None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.067882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 692/1390] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:43:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:43:01.072791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62a48-b91c-4093-b435-dbcf4bc01b6d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.073075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62a48-b91c-4093-b435-dbcf4bc01b6d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.073350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d62a48-b91c-4093-b435-dbcf4bc01b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.108351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:01.134696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:01.136015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:01.139814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-45d62a48-b91c-4093-b435-dbcf4bc01b6d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:01.141078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-45d62a48-b91c-4093-b435-dbcf4bc01b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:01.232577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 699/1391] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:01.239612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 693/1392] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:43:01.523473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:01.524733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:01.540036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:01.543863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34e9bd-626b-480a-aab8-14ba4345fabf None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.544160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34e9bd-626b-480a-aab8-14ba4345fabf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.544473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34e9bd-626b-480a-aab8-14ba4345fabf None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.545816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 694/1393] 10.222.0.27 () {54 vars in 967 bytes} [Mon Aug 22 05:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:43:01.551418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f94711-ac6d-4088-8aff-7ac50b41a27e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.551701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f94711-ac6d-4088-8aff-7ac50b41a27e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.569703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f94711-ac6d-4088-8aff-7ac50b41a27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.635294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b0f94711-ac6d-4088-8aff-7ac50b41a27e None None] MFA Rules not processed for user `38d2e7ee450e44299a99cba466545701`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:01.636568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b0f94711-ac6d-4088-8aff-7ac50b41a27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:01.657660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4565b4e-f837-4a4a-abdf-19cb808e196e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:01.692648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:01.727721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 695/1394] 10.222.0.27 () {58 vars in 1064 bytes} [Mon Aug 22 05:43:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:43:01.736808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f94711-ac6d-4088-8aff-7ac50b41a27e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:01.745794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f94711-ac6d-4088-8aff-7ac50b41a27e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:01.783307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281cf307-2a73-4e9e-8aea-2e5893425fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:01.783930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cf307-2a73-4e9e-8aea-2e5893425fd1 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.784272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cf307-2a73-4e9e-8aea-2e5893425fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.784509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281cf307-2a73-4e9e-8aea-2e5893425fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.786166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-281cf307-2a73-4e9e-8aea-2e5893425fd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:01.794895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:01.824594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c2df0-5ed6-4660-8590-5a05397128dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:01.825209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2df0-5ed6-4660-8590-5a05397128dd service glance] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:01.825599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2df0-5ed6-4660-8590-5a05397128dd service glance] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:01.825881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c2df0-5ed6-4660-8590-5a05397128dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:01.827475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-991c2df0-5ed6-4660-8590-5a05397128dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:01.878715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cf307-2a73-4e9e-8aea-2e5893425fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:01.880479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281cf307-2a73-4e9e-8aea-2e5893425fd1 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:01.898931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 700/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:01.936334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c2df0-5ed6-4660-8590-5a05397128dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:01.937805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c2df0-5ed6-4660-8590-5a05397128dd service glance] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:01.951816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:01.956404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 696/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:43:02.847353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1648f-e296-433e-990f-67af64b2452f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:02.847847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1648f-e296-433e-990f-67af64b2452f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:02.847942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1648f-e296-433e-990f-67af64b2452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:02.916186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-82d1648f-e296-433e-990f-67af64b2452f None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:02.917496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-82d1648f-e296-433e-990f-67af64b2452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:03.002281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:03.005774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 701/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:43:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:03.052440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803649a-c92a-4c18-9796-15648184979d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:03.052932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803649a-c92a-4c18-9796-15648184979d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:03.053052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803649a-c92a-4c18-9796-15648184979d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:03.054406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 697/1398] 10.222.0.27 () {54 vars in 943 bytes} [Mon Aug 22 05:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:03.060931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43fccb-a0b8-4c18-a228-a134ad67e26d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:03.065670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43fccb-a0b8-4c18-a228-a134ad67e26d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:03.065670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43fccb-a0b8-4c18-a228-a134ad67e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:03.139722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6c43fccb-a0b8-4c18-a228-a134ad67e26d None None] MFA Rules not processed for user `9800dbdc23794d9eb02e3c2002b096b2`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:03.140953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6c43fccb-a0b8-4c18-a228-a134ad67e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:03.247871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 702/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Mon Aug 22 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:03.257898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803649a-c92a-4c18-9796-15648184979d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:03.259468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a803649a-c92a-4c18-9796-15648184979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:03.398914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803649a-c92a-4c18-9796-15648184979d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:03.480537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:03.501565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64133a0-e13e-4da3-b3f0-c122e8398490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:03.502168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64133a0-e13e-4da3-b3f0-c122e8398490 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:03.502452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64133a0-e13e-4da3-b3f0-c122e8398490 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:03.502734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64133a0-e13e-4da3-b3f0-c122e8398490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:03.504407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a64133a0-e13e-4da3-b3f0-c122e8398490 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:03.586429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64133a0-e13e-4da3-b3f0-c122e8398490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:03.588351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64133a0-e13e-4da3-b3f0-c122e8398490 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:03.596869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 698/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:43:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:43:03.930967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c438a-a043-4a46-b6dd-98dd589b5c00 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:03.931497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c438a-a043-4a46-b6dd-98dd589b5c00 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:03.931497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c438a-a043-4a46-b6dd-98dd589b5c00 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:03.932880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 703/1401] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:03.938147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2594010-ed3a-4f83-9076-68b97311d9fb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:03.938501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2594010-ed3a-4f83-9076-68b97311d9fb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:03.938779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2594010-ed3a-4f83-9076-68b97311d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:04.005934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f2594010-ed3a-4f83-9076-68b97311d9fb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:04.007141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f2594010-ed3a-4f83-9076-68b97311d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:04.088800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:04.119797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 699/1402] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:04.407905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c438a-a043-4a46-b6dd-98dd589b5c00 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:04.409528 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-141c438a-a043-4a46-b6dd-98dd589b5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:04.492566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:04.593848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c438a-a043-4a46-b6dd-98dd589b5c00 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:04.755965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f208dfb-423b-4f43-8667-ef7e8556ce50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:04.757028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208dfb-423b-4f43-8667-ef7e8556ce50 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:04.757330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208dfb-423b-4f43-8667-ef7e8556ce50 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:04.757708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f208dfb-423b-4f43-8667-ef7e8556ce50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:04.759284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1f208dfb-423b-4f43-8667-ef7e8556ce50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:04.782702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:04.866540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208dfb-423b-4f43-8667-ef7e8556ce50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:04.868188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f208dfb-423b-4f43-8667-ef7e8556ce50 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:04.888524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 704/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:07.330816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7aed70-01eb-4d75-bbad-a336dcb03b6b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:07.330816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7aed70-01eb-4d75-bbad-a336dcb03b6b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:07.330816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7aed70-01eb-4d75-bbad-a336dcb03b6b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:07.331637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 700/1404] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:07.337440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79dc93-4272-4311-bbc4-6edf9502845b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:07.337895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79dc93-4272-4311-bbc4-6edf9502845b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:07.337987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79dc93-4272-4311-bbc4-6edf9502845b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:07.411389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-7c79dc93-4272-4311-bbc4-6edf9502845b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:07.412661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7c79dc93-4272-4311-bbc4-6edf9502845b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:07.516843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:07.532629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 705/1405] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:07.809217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7aed70-01eb-4d75-bbad-a336dcb03b6b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:07.810747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9a7aed70-01eb-4d75-bbad-a336dcb03b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:07.980259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7aed70-01eb-4d75-bbad-a336dcb03b6b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:08.039813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:08.111971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5802e-9e94-4014-a64b-794376ba94b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:08.112618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5802e-9e94-4014-a64b-794376ba94b1 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:08.112904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5802e-9e94-4014-a64b-794376ba94b1 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:08.113181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5802e-9e94-4014-a64b-794376ba94b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:08.114824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a6a5802e-9e94-4014-a64b-794376ba94b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:08.210474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5802e-9e94-4014-a64b-794376ba94b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:08.212432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5802e-9e94-4014-a64b-794376ba94b1 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:08.244267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 701/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:10.288926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b591-090d-4c0a-b7be-4caeb116aee4 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:10.289570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b591-090d-4c0a-b7be-4caeb116aee4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:10.289570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b591-090d-4c0a-b7be-4caeb116aee4 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:10.294903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 706/1407] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:43:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:10.296945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8870e1-c1a5-46a8-a697-35c8312ab926 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:10.297365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8870e1-c1a5-46a8-a697-35c8312ab926 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:10.297536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8870e1-c1a5-46a8-a697-35c8312ab926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:10.384620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-9f8870e1-c1a5-46a8-a697-35c8312ab926 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:10.385950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9f8870e1-c1a5-46a8-a697-35c8312ab926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:10.400781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:10.528451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 702/1408] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:43:10.844280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b591-090d-4c0a-b7be-4caeb116aee4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:10.846023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5f42b591-090d-4c0a-b7be-4caeb116aee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:11.015266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b591-090d-4c0a-b7be-4caeb116aee4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:11.091057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:11.152277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3507b-5796-48f1-9952-6750cddb020a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:11.153098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3507b-5796-48f1-9952-6750cddb020a service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:11.153392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3507b-5796-48f1-9952-6750cddb020a service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:11.153686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3507b-5796-48f1-9952-6750cddb020a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:11.155783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-21e3507b-5796-48f1-9952-6750cddb020a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:11.255176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3507b-5796-48f1-9952-6750cddb020a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:11.256985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3507b-5796-48f1-9952-6750cddb020a service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:11.276105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 707/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:20.736175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=38 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:21.273611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=64 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:26.760913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410e54-cdc6-4d78-ac3b-c0b7742f65b9 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:26.761494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410e54-cdc6-4d78-ac3b-c0b7742f65b9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:26.761494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410e54-cdc6-4d78-ac3b-c0b7742f65b9 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:26.762800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 703/1410] 10.222.0.27 () {54 vars in 918 bytes} [Mon Aug 22 05:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:26.767907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3596-7a40-4b8a-b6b4-c7e784783aeb None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:26.768373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3596-7a40-4b8a-b6b4-c7e784783aeb None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:26.768492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3596-7a40-4b8a-b6b4-c7e784783aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:26.844022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-1c9c3596-7a40-4b8a-b6b4-c7e784783aeb None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:26.845272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1c9c3596-7a40-4b8a-b6b4-c7e784783aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:26.947804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 708/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Aug 22 05:43:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:43:26.961974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21307864-e146-4cb1-8a3e-4b88e301a905 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:26.962269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21307864-e146-4cb1-8a3e-4b88e301a905 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:26.962549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21307864-e146-4cb1-8a3e-4b88e301a905 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:26.963877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 704/1412] 10.222.0.27 () {54 vars in 918 bytes} [Mon Aug 22 05:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:26.969060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556f5e3-57e7-44ed-b902-f0a86ae25a32 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:26.969354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556f5e3-57e7-44ed-b902-f0a86ae25a32 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:26.969639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556f5e3-57e7-44ed-b902-f0a86ae25a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:27.040961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:27.043521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4556f5e3-57e7-44ed-b902-f0a86ae25a32 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:27.044823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4556f5e3-57e7-44ed-b902-f0a86ae25a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:27.158460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 709/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Aug 22 05:43:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:29.527802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f31a1-fb4b-4484-a25f-41ae4485695b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:29.528452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f31a1-fb4b-4484-a25f-41ae4485695b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:29.528452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f31a1-fb4b-4484-a25f-41ae4485695b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:29.529743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:29.535324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10a-1d25-4012-a9cd-cd19bad6675f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:29.535800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10a-1d25-4012-a9cd-cd19bad6675f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:29.535913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f10a-1d25-4012-a9cd-cd19bad6675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:29.602231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-22c6f10a-1d25-4012-a9cd-cd19bad6675f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:29.603340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-22c6f10a-1d25-4012-a9cd-cd19bad6675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:29.656632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:29.697143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:29.989246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f31a1-fb4b-4484-a25f-41ae4485695b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:29.990778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-856f31a1-fb4b-4484-a25f-41ae4485695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:30.131316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f31a1-fb4b-4484-a25f-41ae4485695b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:30.201727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:30.241526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e59d9-fa93-4839-8bd7-a7383253ac25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:30.242065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e59d9-fa93-4839-8bd7-a7383253ac25 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:30.242350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e59d9-fa93-4839-8bd7-a7383253ac25 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:30.242629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e59d9-fa93-4839-8bd7-a7383253ac25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:30.244238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-799e59d9-fa93-4839-8bd7-a7383253ac25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:30.331742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e59d9-fa93-4839-8bd7-a7383253ac25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:30.333379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e59d9-fa93-4839-8bd7-a7383253ac25 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:30.352088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 706/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:31.247786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c6dc-4faa-409f-aa21-be7b1050df81 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:31.248375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c6dc-4faa-409f-aa21-be7b1050df81 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:31.248375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3c6dc-4faa-409f-aa21-be7b1050df81 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:31.249722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:31.254812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb080a-1840-45a2-82b0-7891dbc83c0f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:31.255233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb080a-1840-45a2-82b0-7891dbc83c0f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:31.255367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb080a-1840-45a2-82b0-7891dbc83c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:31.331239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-26eb080a-1840-45a2-82b0-7891dbc83c0f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:31.332461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-26eb080a-1840-45a2-82b0-7891dbc83c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:31.359549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:31.427903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:31.579456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c6dc-4faa-409f-aa21-be7b1050df81 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:31.580948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8ed3c6dc-4faa-409f-aa21-be7b1050df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:31.724680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3c6dc-4faa-409f-aa21-be7b1050df81 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:31.762788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:31.834163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c45ba3-b361-444b-90af-4061a62c29bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:31.834704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c45ba3-b361-444b-90af-4061a62c29bc service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:31.835018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c45ba3-b361-444b-90af-4061a62c29bc service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:31.835299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c45ba3-b361-444b-90af-4061a62c29bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:31.837284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a7c45ba3-b361-444b-90af-4061a62c29bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:31.925135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c45ba3-b361-444b-90af-4061a62c29bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:31.926766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c45ba3-b361-444b-90af-4061a62c29bc service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:31.944602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 712/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:32.820971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547061d7-4f45-4429-ba3d-8f994ea5dff7 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:32.821543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547061d7-4f45-4429-ba3d-8f994ea5dff7 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:32.821543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547061d7-4f45-4429-ba3d-8f994ea5dff7 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:32.822898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:32.827803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ec41-982c-48b3-9dcc-c0bb6502d403 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:32.832995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ec41-982c-48b3-9dcc-c0bb6502d403 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:32.832995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ec41-982c-48b3-9dcc-c0bb6502d403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:32.883595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:32.904757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-7741ec41-982c-48b3-9dcc-c0bb6502d403 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:32.906028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7741ec41-982c-48b3-9dcc-c0bb6502d403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:33.001922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:33.152967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547061d7-4f45-4429-ba3d-8f994ea5dff7 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:33.155070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-547061d7-4f45-4429-ba3d-8f994ea5dff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:33.296235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547061d7-4f45-4429-ba3d-8f994ea5dff7 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:33.308390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:33.406298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f0f7b-bb69-438c-b1e9-01e5e7c53c3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:33.406828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f0f7b-bb69-438c-b1e9-01e5e7c53c3b service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:33.407109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f0f7b-bb69-438c-b1e9-01e5e7c53c3b service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:33.407386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f0f7b-bb69-438c-b1e9-01e5e7c53c3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:33.409011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c07f0f7b-bb69-438c-b1e9-01e5e7c53c3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:33.494637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f0f7b-bb69-438c-b1e9-01e5e7c53c3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:33.496243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f0f7b-bb69-438c-b1e9-01e5e7c53c3b service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:33.514710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 709/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:34.366650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca8f9-fa57-49af-9ae3-9fee54cd4068 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:34.367181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca8f9-fa57-49af-9ae3-9fee54cd4068 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:34.367181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeca8f9-fa57-49af-9ae3-9fee54cd4068 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:34.368587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:34.373553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae78ee-dd1b-4ccb-8f51-57c5a78b6079 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:34.374019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae78ee-dd1b-4ccb-8f51-57c5a78b6079 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:34.374126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae78ee-dd1b-4ccb-8f51-57c5a78b6079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:34.393715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:34.449680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f6ae78ee-dd1b-4ccb-8f51-57c5a78b6079 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:34.450873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f6ae78ee-dd1b-4ccb-8f51-57c5a78b6079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:34.545193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:34.693561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeca8f9-fa57-49af-9ae3-9fee54cd4068 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:34.695113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fdeca8f9-fa57-49af-9ae3-9fee54cd4068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:34.802670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:34.838673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeca8f9-fa57-49af-9ae3-9fee54cd4068 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:34.949264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d90284-77f1-4b9e-b03e-1966dbc387c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:34.949872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d90284-77f1-4b9e-b03e-1966dbc387c8 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:34.950155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d90284-77f1-4b9e-b03e-1966dbc387c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:34.950430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d90284-77f1-4b9e-b03e-1966dbc387c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:34.952686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-42d90284-77f1-4b9e-b03e-1966dbc387c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:35.026301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:35.039441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d90284-77f1-4b9e-b03e-1966dbc387c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:35.041085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d90284-77f1-4b9e-b03e-1966dbc387c8 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:35.058947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 715/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:35.918092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0eecd-253c-4d12-bd12-f5fb452f3ad1 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:35.918580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0eecd-253c-4d12-bd12-f5fb452f3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:35.918684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0eecd-253c-4d12-bd12-f5fb452f3ad1 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:35.920689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:35.925669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24426-1eee-4f24-8a2c-2249fbbf7b45 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:35.930205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24426-1eee-4f24-8a2c-2249fbbf7b45 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:35.930205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b24426-1eee-4f24-8a2c-2249fbbf7b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:36.002566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-79b24426-1eee-4f24-8a2c-2249fbbf7b45 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:36.003762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-79b24426-1eee-4f24-8a2c-2249fbbf7b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:36.101136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:36.250904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0eecd-253c-4d12-bd12-f5fb452f3ad1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:36.252373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f2e0eecd-253c-4d12-bd12-f5fb452f3ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:36.334934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:36.396507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0eecd-253c-4d12-bd12-f5fb452f3ad1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:36.505754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ef4f0-a74a-4ad2-a33d-5b23aff7dcbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:36.506289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef4f0-a74a-4ad2-a33d-5b23aff7dcbd service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:36.506579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef4f0-a74a-4ad2-a33d-5b23aff7dcbd service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:36.506861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ef4f0-a74a-4ad2-a33d-5b23aff7dcbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:36.508518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-310ef4f0-a74a-4ad2-a33d-5b23aff7dcbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:36.555109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:36.596240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef4f0-a74a-4ad2-a33d-5b23aff7dcbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:36.597850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ef4f0-a74a-4ad2-a33d-5b23aff7dcbd service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:36.615257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 712/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:37.481411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44796d-2cef-43ab-9ef4-98ef1d40dd43 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:37.481972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44796d-2cef-43ab-9ef4-98ef1d40dd43 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:37.481972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44796d-2cef-43ab-9ef4-98ef1d40dd43 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:37.483928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:37.488962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48ad06-f9ce-44d1-97bc-6950fdf567cc None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:37.489397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48ad06-f9ce-44d1-97bc-6950fdf567cc None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:37.489516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48ad06-f9ce-44d1-97bc-6950fdf567cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:37.563831 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-aa48ad06-f9ce-44d1-97bc-6950fdf567cc None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:37.564991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-aa48ad06-f9ce-44d1-97bc-6950fdf567cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:37.659599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:37.807522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44796d-2cef-43ab-9ef4-98ef1d40dd43 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:37.809056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8c44796d-2cef-43ab-9ef4-98ef1d40dd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:37.856749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:37.950658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44796d-2cef-43ab-9ef4-98ef1d40dd43 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:38.058639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d86b1-f0dd-4922-86a7-1c96a16476a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:38.059247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d86b1-f0dd-4922-86a7-1c96a16476a4 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:38.059527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d86b1-f0dd-4922-86a7-1c96a16476a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:38.059798 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d86b1-f0dd-4922-86a7-1c96a16476a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:38.061918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d55d86b1-f0dd-4922-86a7-1c96a16476a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:38.068649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:38.152706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d86b1-f0dd-4922-86a7-1c96a16476a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:38.154280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d86b1-f0dd-4922-86a7-1c96a16476a4 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:38.171466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 718/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:39.025718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021704d-9ce7-430d-a380-5c6d2552c75c None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:39.026254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021704d-9ce7-430d-a380-5c6d2552c75c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:39.026254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021704d-9ce7-430d-a380-5c6d2552c75c None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:39.027637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:39.033203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49672-2043-4160-9ed3-1cf4b5749af4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:39.033638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49672-2043-4160-9ed3-1cf4b5749af4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:39.033751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a49672-2043-4160-9ed3-1cf4b5749af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:39.223843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b0a49672-2043-4160-9ed3-1cf4b5749af4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:39.225064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b0a49672-2043-4160-9ed3-1cf4b5749af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:39.291714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:39.319497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:39.470589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021704d-9ce7-430d-a380-5c6d2552c75c None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:39.472124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5021704d-9ce7-430d-a380-5c6d2552c75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:39.489612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:39.613237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021704d-9ce7-430d-a380-5c6d2552c75c None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:39.701870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:39.727078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85398f31-10fc-474f-bcdc-0d7b14286665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:39.727725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85398f31-10fc-474f-bcdc-0d7b14286665 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:39.728012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85398f31-10fc-474f-bcdc-0d7b14286665 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:39.728320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85398f31-10fc-474f-bcdc-0d7b14286665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:39.729983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-85398f31-10fc-474f-bcdc-0d7b14286665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:39.817155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85398f31-10fc-474f-bcdc-0d7b14286665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:39.818675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85398f31-10fc-474f-bcdc-0d7b14286665 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:39.836176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 715/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:40.695014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1525-7e96-4aa9-8057-f4e24c96091e None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:40.695556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1525-7e96-4aa9-8057-f4e24c96091e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:40.695556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba1525-7e96-4aa9-8057-f4e24c96091e None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:40.696991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:40.702314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e38214-15f7-4e81-a066-e660d5b64309 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:40.702737 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e38214-15f7-4e81-a066-e660d5b64309 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:40.702863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e38214-15f7-4e81-a066-e660d5b64309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:40.777652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-65e38214-15f7-4e81-a066-e660d5b64309 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:40.778845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-65e38214-15f7-4e81-a066-e660d5b64309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:40.818698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:40.875331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:41.024448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba1525-7e96-4aa9-8057-f4e24c96091e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:41.025857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-bdba1525-7e96-4aa9-8057-f4e24c96091e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:41.169500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba1525-7e96-4aa9-8057-f4e24c96091e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:41.222997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:41.280699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b4d49-6d92-4ce6-a6d8-0e8a2dad2db7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:41.281233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4d49-6d92-4ce6-a6d8-0e8a2dad2db7 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:41.281512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4d49-6d92-4ce6-a6d8-0e8a2dad2db7 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:41.281783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b4d49-6d92-4ce6-a6d8-0e8a2dad2db7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:41.283366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-cb6b4d49-6d92-4ce6-a6d8-0e8a2dad2db7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:41.376800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4d49-6d92-4ce6-a6d8-0e8a2dad2db7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:41.378427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b4d49-6d92-4ce6-a6d8-0e8a2dad2db7 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:41.395938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 721/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:42.247132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4016aad-ef42-4e33-afab-7931d44dd49f None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:42.247684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4016aad-ef42-4e33-afab-7931d44dd49f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:42.247684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4016aad-ef42-4e33-afab-7931d44dd49f None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:42.249060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:42.253869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044b44-f896-4736-9b49-1a9070725a42 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:42.254284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044b44-f896-4736-9b49-1a9070725a42 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:42.254434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044b44-f896-4736-9b49-1a9070725a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:42.329032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-eb044b44-f896-4736-9b49-1a9070725a42 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:42.330225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-eb044b44-f896-4736-9b49-1a9070725a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:42.332230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:42.424261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:42.572947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4016aad-ef42-4e33-afab-7931d44dd49f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:42.574411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a4016aad-ef42-4e33-afab-7931d44dd49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:42.715276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4016aad-ef42-4e33-afab-7931d44dd49f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:42.741417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:42.829988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3dc87-1cbb-4402-b33c-5f707b475cca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:42.829988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dc87-1cbb-4402-b33c-5f707b475cca service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:42.829988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dc87-1cbb-4402-b33c-5f707b475cca service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:42.829988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3dc87-1cbb-4402-b33c-5f707b475cca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:42.830514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9df3dc87-1cbb-4402-b33c-5f707b475cca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:42.916348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3dc87-1cbb-4402-b33c-5f707b475cca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:42.917988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3dc87-1cbb-4402-b33c-5f707b475cca service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:42.936944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 718/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:44.750875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bfa25-019e-4b1b-a0f6-e22cbb7b1a9d None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:44.751414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bfa25-019e-4b1b-a0f6-e22cbb7b1a9d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:44.751414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bfa25-019e-4b1b-a0f6-e22cbb7b1a9d None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:44.752818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:44.758286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebab0f-89e1-42b1-95d8-88171ed8fc09 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:44.758713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebab0f-89e1-42b1-95d8-88171ed8fc09 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:44.758852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebab0f-89e1-42b1-95d8-88171ed8fc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:44.799340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:44.824063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-62ebab0f-89e1-42b1-95d8-88171ed8fc09 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:44.825296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-62ebab0f-89e1-42b1-95d8-88171ed8fc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:44.919330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:45.202478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bfa25-019e-4b1b-a0f6-e22cbb7b1a9d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:45.204020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e53bfa25-019e-4b1b-a0f6-e22cbb7b1a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:45.306747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bfa25-019e-4b1b-a0f6-e22cbb7b1a9d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:45.338231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:45.378981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce8186-23f7-4524-8cda-b8b75de6edfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:45.379642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8186-23f7-4524-8cda-b8b75de6edfd service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:45.380150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8186-23f7-4524-8cda-b8b75de6edfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:45.380638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce8186-23f7-4524-8cda-b8b75de6edfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:45.382595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f4ce8186-23f7-4524-8cda-b8b75de6edfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:45.494769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8186-23f7-4524-8cda-b8b75de6edfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:45.496116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce8186-23f7-4524-8cda-b8b75de6edfd service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:45.515117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 724/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:47.583027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3009-e6d9-4da2-9ccc-a11eab9c0a9f None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:47.583620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3009-e6d9-4da2-9ccc-a11eab9c0a9f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:47.583620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db3009-e6d9-4da2-9ccc-a11eab9c0a9f None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:47.584902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:47.590590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279d0ea-baba-4e83-81e2-0ea8af0eec2c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:47.591531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279d0ea-baba-4e83-81e2-0ea8af0eec2c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:47.591649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b279d0ea-baba-4e83-81e2-0ea8af0eec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:47.657363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b279d0ea-baba-4e83-81e2-0ea8af0eec2c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:47.658566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b279d0ea-baba-4e83-81e2-0ea8af0eec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:47.671584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:47.753258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:48.039670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3009-e6d9-4da2-9ccc-a11eab9c0a9f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:48.041235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-54db3009-e6d9-4da2-9ccc-a11eab9c0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:48.141053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db3009-e6d9-4da2-9ccc-a11eab9c0a9f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:48.152626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:48.213020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ec4d8-d4ef-4bea-b8b6-83e41a6a4976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:48.213617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ec4d8-d4ef-4bea-b8b6-83e41a6a4976 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:48.213898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ec4d8-d4ef-4bea-b8b6-83e41a6a4976 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:48.214173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ec4d8-d4ef-4bea-b8b6-83e41a6a4976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:48.215745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-900ec4d8-d4ef-4bea-b8b6-83e41a6a4976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:48.321378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ec4d8-d4ef-4bea-b8b6-83e41a6a4976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:48.322837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ec4d8-d4ef-4bea-b8b6-83e41a6a4976 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:48.341728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 721/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:50.601355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c699d4-2664-47a7-87c4-e8dc975de6cd None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:50.601913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c699d4-2664-47a7-87c4-e8dc975de6cd None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:50.601913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c699d4-2664-47a7-87c4-e8dc975de6cd None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:50.603225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:50.609073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366ae6-e9c1-4638-9dfb-4dfd3a5bdf36 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:50.609498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366ae6-e9c1-4638-9dfb-4dfd3a5bdf36 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:50.609633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9366ae6-e9c1-4638-9dfb-4dfd3a5bdf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:50.657542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:50.676108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a9366ae6-e9c1-4638-9dfb-4dfd3a5bdf36 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:50.685571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a9366ae6-e9c1-4638-9dfb-4dfd3a5bdf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:50.772150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:51.057030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c699d4-2664-47a7-87c4-e8dc975de6cd None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:51.058630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c6c699d4-2664-47a7-87c4-e8dc975de6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:51.160356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c699d4-2664-47a7-87c4-e8dc975de6cd None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:51.198286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:51.231670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41079a4-36e3-4e83-a6ec-10a244bf41e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:51.232301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41079a4-36e3-4e83-a6ec-10a244bf41e0 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:51.232587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41079a4-36e3-4e83-a6ec-10a244bf41e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:51.232864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41079a4-36e3-4e83-a6ec-10a244bf41e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:51.234505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e41079a4-36e3-4e83-a6ec-10a244bf41e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:51.341812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41079a4-36e3-4e83-a6ec-10a244bf41e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:51.343260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41079a4-36e3-4e83-a6ec-10a244bf41e0 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:51.362101 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 727/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:53.366006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18158d7-295b-40ba-a335-b422ff133ea1 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:53.366638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18158d7-295b-40ba-a335-b422ff133ea1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:53.366638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18158d7-295b-40ba-a335-b422ff133ea1 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:53.367930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:53.373876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12ad9-6f3b-4d54-8128-9d892452e568 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:53.374296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12ad9-6f3b-4d54-8128-9d892452e568 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:53.374431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d12ad9-6f3b-4d54-8128-9d892452e568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:53.438148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c3d12ad9-6f3b-4d54-8128-9d892452e568 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:53.439340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c3d12ad9-6f3b-4d54-8128-9d892452e568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:53.458880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:53.532885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:53.814570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18158d7-295b-40ba-a335-b422ff133ea1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:53.816108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f18158d7-295b-40ba-a335-b422ff133ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:53.917027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18158d7-295b-40ba-a335-b422ff133ea1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:53.936608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:53.988929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438af8a-3ada-42c9-a192-1288d544d9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:53.989530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438af8a-3ada-42c9-a192-1288d544d9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:53.989815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438af8a-3ada-42c9-a192-1288d544d9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:53.990094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438af8a-3ada-42c9-a192-1288d544d9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:53.991677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6438af8a-3ada-42c9-a192-1288d544d9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:54.097319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438af8a-3ada-42c9-a192-1288d544d9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:54.098684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438af8a-3ada-42c9-a192-1288d544d9c6 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:54.115913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 724/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:56.074462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e90348-7c40-49e8-b556-4fa240542241 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:56.075571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e90348-7c40-49e8-b556-4fa240542241 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:56.075687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e90348-7c40-49e8-b556-4fa240542241 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:56.077030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:56.082416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d478-2ef3-48a1-be3c-cccb67fa8c76 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:56.082857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d478-2ef3-48a1-be3c-cccb67fa8c76 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:56.082966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405d478-2ef3-48a1-be3c-cccb67fa8c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:56.145428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:56.147957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2405d478-2ef3-48a1-be3c-cccb67fa8c76 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:56.149220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2405d478-2ef3-48a1-be3c-cccb67fa8c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:56.244838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:56.533373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e90348-7c40-49e8-b556-4fa240542241 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:56.534907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-55e90348-7c40-49e8-b556-4fa240542241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:56.637398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e90348-7c40-49e8-b556-4fa240542241 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:56.685589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:56.709387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e19af8f-1e90-46a9-b028-14e3fcc31ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:56.713072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19af8f-1e90-46a9-b028-14e3fcc31ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:56.713072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19af8f-1e90-46a9-b028-14e3fcc31ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:56.713072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19af8f-1e90-46a9-b028-14e3fcc31ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:56.713072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1e19af8f-1e90-46a9-b028-14e3fcc31ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:56.817669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19af8f-1e90-46a9-b028-14e3fcc31ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:56.819029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e19af8f-1e90-46a9-b028-14e3fcc31ed7 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:56.837308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 730/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:43:58.795433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee08b-6bc4-4252-abd2-f7d9f92058a6 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:58.795949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee08b-6bc4-4252-abd2-f7d9f92058a6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:58.796057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee08b-6bc4-4252-abd2-f7d9f92058a6 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:58.797426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:43:58.802583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74953f7a-16e2-45d4-9ee7-2a965cb7f569 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:58.803028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74953f7a-16e2-45d4-9ee7-2a965cb7f569 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:58.803144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74953f7a-16e2-45d4-9ee7-2a965cb7f569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:58.870358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-74953f7a-16e2-45d4-9ee7-2a965cb7f569 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:43:58.871661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-74953f7a-16e2-45d4-9ee7-2a965cb7f569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:58.899857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:58.966423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:43:59.256887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dee08b-6bc4-4252-abd2-f7d9f92058a6 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:43:59.258425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-27dee08b-6bc4-4252-abd2-f7d9f92058a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:59.364128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dee08b-6bc4-4252-abd2-f7d9f92058a6 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:43:59.392254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:43:59.436395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcfaed-fc46-4c1c-bf30-ea48a37ba188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:43:59.436991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfaed-fc46-4c1c-bf30-ea48a37ba188 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:43:59.437266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfaed-fc46-4c1c-bf30-ea48a37ba188 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:43:59.437534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcfaed-fc46-4c1c-bf30-ea48a37ba188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:43:59.439129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-29dcfaed-fc46-4c1c-bf30-ea48a37ba188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:43:59.545709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcfaed-fc46-4c1c-bf30-ea48a37ba188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:43:59.547161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcfaed-fc46-4c1c-bf30-ea48a37ba188 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:43:59.565030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 727/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:01.510187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df75f8e-bdca-4575-a00c-3d1f8077245b None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:01.510739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df75f8e-bdca-4575-a00c-3d1f8077245b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:01.510739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df75f8e-bdca-4575-a00c-3d1f8077245b None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:01.512602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:01.518055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29944d-bc82-4c9b-b3e2-0fc0cd6f0d7b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:01.518476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29944d-bc82-4c9b-b3e2-0fc0cd6f0d7b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:01.518617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb29944d-bc82-4c9b-b3e2-0fc0cd6f0d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:01.582374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-cb29944d-bc82-4c9b-b3e2-0fc0cd6f0d7b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:01.583487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-cb29944d-bc82-4c9b-b3e2-0fc0cd6f0d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:01.592539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:01.678872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:01.965104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df75f8e-bdca-4575-a00c-3d1f8077245b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:01.966646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0df75f8e-bdca-4575-a00c-3d1f8077245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:02.075831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df75f8e-bdca-4575-a00c-3d1f8077245b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:02.129233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:02.147895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d94ef9-e747-4793-99ca-5fc5111c4968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:02.148532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94ef9-e747-4793-99ca-5fc5111c4968 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:02.148816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94ef9-e747-4793-99ca-5fc5111c4968 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:02.149091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d94ef9-e747-4793-99ca-5fc5111c4968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:02.150675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-04d94ef9-e747-4793-99ca-5fc5111c4968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:02.257770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d94ef9-e747-4793-99ca-5fc5111c4968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:02.259139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d94ef9-e747-4793-99ca-5fc5111c4968 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:02.277188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 733/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:04.305331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69113d45-ff5e-498f-855b-62f45c3d579b None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:04.305776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69113d45-ff5e-498f-855b-62f45c3d579b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:04.305905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69113d45-ff5e-498f-855b-62f45c3d579b None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:04.307262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:04.312623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a22f9a-8358-4787-9766-e38ac7d7a6b1 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:04.313004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a22f9a-8358-4787-9766-e38ac7d7a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:04.313174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a22f9a-8358-4787-9766-e38ac7d7a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:04.378129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-81a22f9a-8358-4787-9766-e38ac7d7a6b1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:04.379343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-81a22f9a-8358-4787-9766-e38ac7d7a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:04.416109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:04.472581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:04.756408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69113d45-ff5e-498f-855b-62f45c3d579b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:04.757969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-69113d45-ff5e-498f-855b-62f45c3d579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:04.860832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69113d45-ff5e-498f-855b-62f45c3d579b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:04.899184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:04.933370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347bf77-0e77-4e14-896e-90851385564e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:04.934494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347bf77-0e77-4e14-896e-90851385564e service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:04.934782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347bf77-0e77-4e14-896e-90851385564e service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:04.935063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347bf77-0e77-4e14-896e-90851385564e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:04.936683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7347bf77-0e77-4e14-896e-90851385564e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:05.042433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347bf77-0e77-4e14-896e-90851385564e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:05.043843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347bf77-0e77-4e14-896e-90851385564e service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:05.061829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 730/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:06.987811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab44b4-7b3a-48af-ad23-ee1e016497fc None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:06.988436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab44b4-7b3a-48af-ad23-ee1e016497fc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:06.988436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab44b4-7b3a-48af-ad23-ee1e016497fc None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:06.989751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:06.995093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7371f-2779-46fd-95fd-5d9f606f3323 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:06.995541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7371f-2779-46fd-95fd-5d9f606f3323 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:06.995652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7371f-2779-46fd-95fd-5d9f606f3323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:07.060379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c5e7371f-2779-46fd-95fd-5d9f606f3323 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:07.061606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c5e7371f-2779-46fd-95fd-5d9f606f3323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:07.079597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:07.157349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:44:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:07.465716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab44b4-7b3a-48af-ad23-ee1e016497fc None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:07.467251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9cab44b4-7b3a-48af-ad23-ee1e016497fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:07.568356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab44b4-7b3a-48af-ad23-ee1e016497fc None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:07.644078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:07.650903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7005d-e14b-4ead-8e08-e6846a5ee337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:07.651513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7005d-e14b-4ead-8e08-e6846a5ee337 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:07.651792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7005d-e14b-4ead-8e08-e6846a5ee337 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:07.652065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7005d-e14b-4ead-8e08-e6846a5ee337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:07.654337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8ce7005d-e14b-4ead-8e08-e6846a5ee337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:07.759827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7005d-e14b-4ead-8e08-e6846a5ee337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:07.762317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7005d-e14b-4ead-8e08-e6846a5ee337 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:07.780465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 736/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:09.698770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36966ab-6e90-414e-87e6-a8dbac4698e8 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:09.699249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36966ab-6e90-414e-87e6-a8dbac4698e8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:09.699367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36966ab-6e90-414e-87e6-a8dbac4698e8 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:09.700763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:09.706245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd62e6e-7f44-4714-b88a-de8f9cc0b10e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:09.706683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd62e6e-7f44-4714-b88a-de8f9cc0b10e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:09.706807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd62e6e-7f44-4714-b88a-de8f9cc0b10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:09.771792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-8dd62e6e-7f44-4714-b88a-de8f9cc0b10e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:09.773017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8dd62e6e-7f44-4714-b88a-de8f9cc0b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:09.820469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:09.870782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:10.152147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36966ab-6e90-414e-87e6-a8dbac4698e8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:10.153729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c36966ab-6e90-414e-87e6-a8dbac4698e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:10.254342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36966ab-6e90-414e-87e6-a8dbac4698e8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:10.303008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:10.329253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a662b9-753b-4d30-9ba3-2badb1d05b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:10.331451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a662b9-753b-4d30-9ba3-2badb1d05b51 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:10.331451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a662b9-753b-4d30-9ba3-2badb1d05b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:10.331451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a662b9-753b-4d30-9ba3-2badb1d05b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:10.331962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-51a662b9-753b-4d30-9ba3-2badb1d05b51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:10.436710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a662b9-753b-4d30-9ba3-2badb1d05b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:10.438070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a662b9-753b-4d30-9ba3-2badb1d05b51 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:10.455746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 733/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:19.868988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=22 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:20.453560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=66 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:29.781139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b3a2a-a376-40bc-995c-bde21f934296 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:29.781725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b3a2a-a376-40bc-995c-bde21f934296 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:29.781725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b3a2a-a376-40bc-995c-bde21f934296 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:29.783069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 738/1471] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:29.788364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70765a-59cf-4bf6-ac63-0ffef50a5c55 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:29.788778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70765a-59cf-4bf6-ac63-0ffef50a5c55 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:29.788926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70765a-59cf-4bf6-ac63-0ffef50a5c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:29.853651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4a70765a-59cf-4bf6-ac63-0ffef50a5c55 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:29.854844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4a70765a-59cf-4bf6-ac63-0ffef50a5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:29.951095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 734/1472] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:30.244030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea8fa-d3bc-4414-b658-014f649d7226 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:30.244365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea8fa-d3bc-4414-b658-014f649d7226 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:30.244645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea8fa-d3bc-4414-b658-014f649d7226 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:30.246608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 739/1473] 10.222.0.27 () {54 vars in 967 bytes} [Mon Aug 22 05:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:30.251473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbeb11-b85d-4c69-84e7-463e8e01fa0d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:30.251764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbeb11-b85d-4c69-84e7-463e8e01fa0d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:30.252044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbeb11-b85d-4c69-84e7-463e8e01fa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:30.329348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4bdbeb11-b85d-4c69-84e7-463e8e01fa0d None None] MFA Rules not processed for user `38d2e7ee450e44299a99cba466545701`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:30.330547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4bdbeb11-b85d-4c69-84e7-463e8e01fa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:30.350994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:30.405175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 735/1474] 10.222.0.27 () {58 vars in 1064 bytes} [Mon Aug 22 05:44:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:30.412830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea8fa-d3bc-4414-b658-014f649d7226 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:30.414318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8d6ea8fa-d3bc-4414-b658-014f649d7226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:30.513684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea8fa-d3bc-4414-b658-014f649d7226 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:30.583379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8334a02-a480-4b04-917e-ab9a56febf71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:30.583975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334a02-a480-4b04-917e-ab9a56febf71 service glance] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:30.584280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334a02-a480-4b04-917e-ab9a56febf71 service glance] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:30.584557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8334a02-a480-4b04-917e-ab9a56febf71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:30.586365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a8334a02-a480-4b04-917e-ab9a56febf71 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:30.638227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:30.691824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8334a02-a480-4b04-917e-ab9a56febf71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:30.693304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8334a02-a480-4b04-917e-ab9a56febf71 service glance] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:30.711434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 740/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:32.683993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a0f7-fba2-4cde-a539-df5802d42ded None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:32.684601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a0f7-fba2-4cde-a539-df5802d42ded None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:32.684601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2a0f7-fba2-4cde-a539-df5802d42ded None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:32.685919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 736/1476] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:32.691103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9bd8-d3f2-4193-904b-fe9c1bb7fcd6 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:32.691566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9bd8-d3f2-4193-904b-fe9c1bb7fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:32.691681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e9bd8-d3f2-4193-904b-fe9c1bb7fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:32.755520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e78e9bd8-d3f2-4193-904b-fe9c1bb7fcd6 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:32.756738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e78e9bd8-d3f2-4193-904b-fe9c1bb7fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:32.851234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 741/1477] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:33.128847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2a0f7-fba2-4cde-a539-df5802d42ded None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:33.130385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ffb2a0f7-fba2-4cde-a539-df5802d42ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:33.253645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2a0f7-fba2-4cde-a539-df5802d42ded None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:33.421607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:33.465302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8497dcf-3006-42d1-b684-b7e58870fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:33.465908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497dcf-3006-42d1-b684-b7e58870fc02 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:33.466185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497dcf-3006-42d1-b684-b7e58870fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:33.466458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8497dcf-3006-42d1-b684-b7e58870fc02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:33.467101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8497dcf-3006-42d1-b684-b7e58870fc02 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:33.468856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-c8497dcf-3006-42d1-b684-b7e58870fc02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:44:33.468856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:44:33.468856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:44:33.469991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8497dcf-3006-42d1-b684-b7e58870fc02 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:33.488487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 737/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Aug 22 05:44:33 2022] GET /identity/v3/projects => generated 2553 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:44:35.392577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acb93-6447-40e6-8fc7-13959e2c5324 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:35.393100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acb93-6447-40e6-8fc7-13959e2c5324 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:35.393227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51acb93-6447-40e6-8fc7-13959e2c5324 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:35.394514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 742/1479] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:35.399644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87a5ef-83e2-4206-a840-10aeff8c1e8e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:35.400036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87a5ef-83e2-4206-a840-10aeff8c1e8e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:35.400243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87a5ef-83e2-4206-a840-10aeff8c1e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:35.464975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ae87a5ef-83e2-4206-a840-10aeff8c1e8e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:35.466177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ae87a5ef-83e2-4206-a840-10aeff8c1e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:35.559697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 738/1480] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:35.853671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acb93-6447-40e6-8fc7-13959e2c5324 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:35.855231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b51acb93-6447-40e6-8fc7-13959e2c5324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:35.865125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:36.003553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51acb93-6447-40e6-8fc7-13959e2c5324 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:36.082358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:36.114981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757d05e-80b8-448c-9628-790acccc1eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:36.115584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d05e-80b8-448c-9628-790acccc1eaf service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:36.115868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d05e-80b8-448c-9628-790acccc1eaf service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:36.116142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757d05e-80b8-448c-9628-790acccc1eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:36.117760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f757d05e-80b8-448c-9628-790acccc1eaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:36.205377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d05e-80b8-448c-9628-790acccc1eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:36.206969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757d05e-80b8-448c-9628-790acccc1eaf service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:36.224749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 743/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:38.330725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891ee1-dbad-481b-bf35-bfb14b99c191 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:38.331231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891ee1-dbad-481b-bf35-bfb14b99c191 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:38.331349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29891ee1-dbad-481b-bf35-bfb14b99c191 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:38.332684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 739/1482] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:38.339046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa104-c76c-4161-b238-0784680d88cc None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:38.339496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa104-c76c-4161-b238-0784680d88cc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:38.339621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fa104-c76c-4161-b238-0784680d88cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:38.404672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5b8fa104-c76c-4161-b238-0784680d88cc None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:38.405900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5b8fa104-c76c-4161-b238-0784680d88cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:38.451299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:38.501577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 744/1483] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:38.791957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29891ee1-dbad-481b-bf35-bfb14b99c191 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:38.793500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-29891ee1-dbad-481b-bf35-bfb14b99c191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:38.816623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:38.896050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29891ee1-dbad-481b-bf35-bfb14b99c191 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:38.968523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5309a5-3b66-45ad-87e2-ab60a99c1aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:38.969117 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5309a5-3b66-45ad-87e2-ab60a99c1aba service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:38.969397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5309a5-3b66-45ad-87e2-ab60a99c1aba service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:38.969670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5309a5-3b66-45ad-87e2-ab60a99c1aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:38.971256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7a5309a5-3b66-45ad-87e2-ab60a99c1aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:39.043666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:39.077291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5309a5-3b66-45ad-87e2-ab60a99c1aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:39.078732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5309a5-3b66-45ad-87e2-ab60a99c1aba service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:39.096367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 740/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:41.047971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c59c2-1d46-49ca-92af-c2c7804213b2 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:41.048511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c59c2-1d46-49ca-92af-c2c7804213b2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:41.048511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c59c2-1d46-49ca-92af-c2c7804213b2 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:41.049888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 745/1485] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:41.055108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230050-c071-4690-9649-3ee0f4bb3a8c None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:41.055542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230050-c071-4690-9649-3ee0f4bb3a8c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:41.055670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230050-c071-4690-9649-3ee0f4bb3a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:41.122801 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-6c230050-c071-4690-9649-3ee0f4bb3a8c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:41.124009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6c230050-c071-4690-9649-3ee0f4bb3a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:41.220811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 741/1486] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:44:41.511665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c59c2-1d46-49ca-92af-c2c7804213b2 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:41.513279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d30c59c2-1d46-49ca-92af-c2c7804213b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:41.616654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c59c2-1d46-49ca-92af-c2c7804213b2 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:41.687279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:41.689039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32359ae-d612-4ca4-8c36-94f17a3345a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:41.689644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32359ae-d612-4ca4-8c36-94f17a3345a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:41.689922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32359ae-d612-4ca4-8c36-94f17a3345a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:41.690192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32359ae-d612-4ca4-8c36-94f17a3345a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:41.691835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f32359ae-d612-4ca4-8c36-94f17a3345a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:41.800836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32359ae-d612-4ca4-8c36-94f17a3345a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:41.802279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32359ae-d612-4ca4-8c36-94f17a3345a8 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:41.820169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 746/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:43.866904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b3f8-efdc-4fa1-bf55-e3acb6141e95 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:43.867468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b3f8-efdc-4fa1-bf55-e3acb6141e95 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:43.867565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6466b3f8-efdc-4fa1-bf55-e3acb6141e95 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:43.868880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 742/1488] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:43.873991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5324d-98da-419d-a1cf-437314fcbb0d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:43.874451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5324d-98da-419d-a1cf-437314fcbb0d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:43.874583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5324d-98da-419d-a1cf-437314fcbb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:43.940031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e1f5324d-98da-419d-a1cf-437314fcbb0d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:43.941281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e1f5324d-98da-419d-a1cf-437314fcbb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:43.993392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:44.037001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 747/1489] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:44.323130 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b3f8-efdc-4fa1-bf55-e3acb6141e95 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:44.324702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6466b3f8-efdc-4fa1-bf55-e3acb6141e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:44.360387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:44.425843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6466b3f8-efdc-4fa1-bf55-e3acb6141e95 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:44.495934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcda5d8-0e50-4056-8c33-1336dbf26006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:44.496560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcda5d8-0e50-4056-8c33-1336dbf26006 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:44.496838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcda5d8-0e50-4056-8c33-1336dbf26006 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:44.497110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcda5d8-0e50-4056-8c33-1336dbf26006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:44.498688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9dcda5d8-0e50-4056-8c33-1336dbf26006 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:44.576023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:44.605068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcda5d8-0e50-4056-8c33-1336dbf26006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:44.606653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcda5d8-0e50-4056-8c33-1336dbf26006 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:44.625857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 743/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:46.924502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e666178-c4fb-4aaf-b845-fe214714d7a9 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:46.924999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e666178-c4fb-4aaf-b845-fe214714d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:46.925123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e666178-c4fb-4aaf-b845-fe214714d7a9 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:46.926389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 748/1491] 10.222.0.27 () {54 vars in 927 bytes} [Mon Aug 22 05:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:44:46.932311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ce5df-2ff4-4032-8fa3-5532f0d5d1f3 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:46.932719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ce5df-2ff4-4032-8fa3-5532f0d5d1f3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:46.932903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ce5df-2ff4-4032-8fa3-5532f0d5d1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:46.996942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5f7ce5df-2ff4-4032-8fa3-5532f0d5d1f3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:44:46.998146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5f7ce5df-2ff4-4032-8fa3-5532f0d5d1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:47.092760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 744/1492] 10.222.0.27 () {58 vars in 1024 bytes} [Mon Aug 22 05:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:44:47.379798 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e666178-c4fb-4aaf-b845-fe214714d7a9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:44:47.381367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3e666178-c4fb-4aaf-b845-fe214714d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:47.483741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e666178-c4fb-4aaf-b845-fe214714d7a9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:44:47.554269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3813046-af2f-4593-81d9-7f4d8fb81b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:44:47.554806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813046-af2f-4593-81d9-7f4d8fb81b28 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:44:47.555097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813046-af2f-4593-81d9-7f4d8fb81b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:44:47.555371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3813046-af2f-4593-81d9-7f4d8fb81b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:44:47.557017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e3813046-af2f-4593-81d9-7f4d8fb81b28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:44:47.566985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:47.664949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813046-af2f-4593-81d9-7f4d8fb81b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:44:47.666377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3813046-af2f-4593-81d9-7f4d8fb81b28 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:44:47.684330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 749/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:44:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:44:57.090959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=82 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:44:57.681378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=50 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:28.701124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:28.701717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:28.701717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:28.784563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:46:28.785882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:28.884677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 745/1494] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:46:28.892987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca9b84-0fd8-45a0-954b-fdc898b59e44 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:28.893504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca9b84-0fd8-45a0-954b-fdc898b59e44 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:28.893600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca9b84-0fd8-45a0-954b-fdc898b59e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:28.970862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b9ca9b84-0fd8-45a0-954b-fdc898b59e44 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:46:28.971994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b9ca9b84-0fd8-45a0-954b-fdc898b59e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:29.067504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 750/1495] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:46:29.072859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:29.074072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:29.085503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0617d7-bde1-470e-a130-ab6765d74e30 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:29.145324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:29.178775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:29.179939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:29.180233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:29.180515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:29.181165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:46:29.181473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:29.182487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:29.182487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:46:29.182487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:46:29.183385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:29.194152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 746/1496] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:46:29.202457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca9b84-0fd8-45a0-954b-fdc898b59e44 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:29.211671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca9b84-0fd8-45a0-954b-fdc898b59e44 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:29.270500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:29.303748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:29.305041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:29.305318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:29.305587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:29.306215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:29.307964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING py.warnings [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:29.307964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: warnings.warn(msg) Aug 22 05:46:29.307964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: Aug 22 05:46:29.309187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:29.433655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 751/1497] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:46:29 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:46:29.437796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:29.439321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:29.471406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4323f38-6505-41d6-a253-a8fc9c5025d4 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:29.563393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:29.563916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:29.564217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:29.564490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:29.565123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:29.566132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:29.566132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:46:29.566132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:46:29.567331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:29.661750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 747/1498] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:46:29 2022] POST /identity/v3/users => generated 290 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:46:29.666566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:29.668061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:29.730052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad64efb-6613-4d3e-8059-53ba3f1a1cbe admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:29.812161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:29.822334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:29.822879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:29.823160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:29.823433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:29.824075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:29.825125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING py.warnings [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:29.825125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: warnings.warn(msg) Aug 22 05:46:29.825125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: Aug 22 05:46:29.826058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:29.839095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 752/1499] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:46:29.843078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:29.844631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:29.856891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16438bee-8ab3-4d09-a2ac-76a49d5c2567 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:29.881114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:29.949798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2d0f2-3fc4-4d89-8a26-9993e95e476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:29.950405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2d0f2-3fc4-4d89-8a26-9993e95e476c admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:29.950687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2d0f2-3fc4-4d89-8a26-9993e95e476c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:29.950963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2d0f2-3fc4-4d89-8a26-9993e95e476c admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:29.951640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2d0f2-3fc4-4d89-8a26-9993e95e476c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:29.952685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-37d2d0f2-3fc4-4d89-8a26-9993e95e476c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:29.952685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:46:29.952685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:46:29.953571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2d0f2-3fc4-4d89-8a26-9993e95e476c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:29.967322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 748/1500] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:46:29.971566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:29.973129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:30.004842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3324df-a607-4670-9c60-5c52cb94fec1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:30.096313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec02a8-3563-41f5-897d-7a02512d8dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:30.096896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec02a8-3563-41f5-897d-7a02512d8dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:30.097174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec02a8-3563-41f5-897d-7a02512d8dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:30.097444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec02a8-3563-41f5-897d-7a02512d8dd8 admin admin] PATH_INFO: `/v3/projects/dde465001c014ec191442ea47868c4db/users/f9167078e53e48eab83ec901603d467f/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:30.118214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec02a8-3563-41f5-897d-7a02512d8dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dde465001c014ec191442ea47868c4db, user_id=f9167078e53e48eab83ec901603d467f, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:30.119238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING py.warnings [None req-b3ec02a8-3563-41f5-897d-7a02512d8dd8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:30.119238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: warnings.warn(msg) Aug 22 05:46:30.119238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: Aug 22 05:46:30.121192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec02a8-3563-41f5-897d-7a02512d8dd8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:30.198640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 753/1501] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:46:29 2022] PUT /identity/v3/projects/dde465001c014ec191442ea47868c4db/users/f9167078e53e48eab83ec901603d467f/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:46:30.211500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587eac9-cb45-48fb-94b7-99bc9be307eb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:30.211793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587eac9-cb45-48fb-94b7-99bc9be307eb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:30.212096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587eac9-cb45-48fb-94b7-99bc9be307eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:30.267639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c587eac9-cb45-48fb-94b7-99bc9be307eb None None] MFA Rules not processed for user `f9167078e53e48eab83ec901603d467f`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:46:30.268879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c587eac9-cb45-48fb-94b7-99bc9be307eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:30.348762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 749/1502] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:46:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:46:30.361736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cf0ae-09e3-4d49-a113-3524049eed40 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:30.362033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cf0ae-09e3-4d49-a113-3524049eed40 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:30.362318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cf0ae-09e3-4d49-a113-3524049eed40 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:30.363716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 754/1503] 10.222.0.27 () {54 vars in 964 bytes} [Mon Aug 22 05:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:46:30.369042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec0a6-3ea4-4ae4-b821-2a5ee989c033 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:30.369336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec0a6-3ea4-4ae4-b821-2a5ee989c033 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:30.369617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ec0a6-3ea4-4ae4-b821-2a5ee989c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:30.400987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:30.443639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-610ec0a6-3ea4-4ae4-b821-2a5ee989c033 None None] MFA Rules not processed for user `a1af7582d3e94be1815574887e988e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:46:30.445493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-610ec0a6-3ea4-4ae4-b821-2a5ee989c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:30.519543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 750/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Aug 22 05:46:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:46:30.527155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cf0ae-09e3-4d49-a113-3524049eed40 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:30.528788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e47cf0ae-09e3-4d49-a113-3524049eed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:30.578012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:30.629280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cf0ae-09e3-4d49-a113-3524049eed40 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:30.701147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:30.701756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:30.702048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:30.702323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:30.703915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:30.801638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:30.803076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:30.807150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:30.821127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 755/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:46:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:46:30.865796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154417c2-c11c-4c35-9ebf-036fc8dbaa1d None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:30.866254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154417c2-c11c-4c35-9ebf-036fc8dbaa1d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:30.867006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154417c2-c11c-4c35-9ebf-036fc8dbaa1d None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:30.868271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 751/1506] 10.222.0.27 () {52 vars in 830 bytes} [Mon Aug 22 05:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:46:30.871777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:30.873078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:30.969888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91b817-7081-4c9d-a79d-084e6e1bfe7b service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:31.063413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:31.064092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:31.064404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:31.064689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] PATH_INFO: `/v3/users/f9167078e53e48eab83ec901603d467f` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:31.076794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9167078e53e48eab83ec901603d467f)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:31.077815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING py.warnings [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:31.077815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: warnings.warn(msg) Aug 22 05:46:31.077815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: Aug 22 05:46:31.079041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:31.089642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:31.280862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9167078e53e48eab83ec901603d467f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:31.281229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9167078e53e48eab83ec901603d467f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:31.281759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9167078e53e48eab83ec901603d467f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:31.297327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9167078e53e48eab83ec901603d467f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:31.369826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9167078e53e48eab83ec901603d467f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:31.398941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 756/1507] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:46:30 2022] DELETE /identity/v3/users/f9167078e53e48eab83ec901603d467f => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:46:31.403338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:31.403650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:31.403927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:31.458213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:46:31.459407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:31.533602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:31.545685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 752/1508] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:46:31.555163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:31.556495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:31.654195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd31cc-a007-416d-8712-98b78d1c4732 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:31.709463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:31.728534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b470e76-4cb0-4fb5-9293-00a122b60ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:31.729144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470e76-4cb0-4fb5-9293-00a122b60ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:31.729427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470e76-4cb0-4fb5-9293-00a122b60ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:31.729705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b470e76-4cb0-4fb5-9293-00a122b60ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:31.731286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5b470e76-4cb0-4fb5-9293-00a122b60ed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:31.839822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b470e76-4cb0-4fb5-9293-00a122b60ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:31.841208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b470e76-4cb0-4fb5-9293-00a122b60ed3 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:31.859185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 757/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:46:32.302051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:46:32.304443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:46:32.315083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e9c3f-46c2-4a33-a01e-9b6382a13d65 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:46:32.415102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:46:32.415735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:46:32.416015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:46:32.416322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] PATH_INFO: `/v3/projects/dde465001c014ec191442ea47868c4db` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:46:32.425800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] RBAC: Authorizing `identity:delete_project(project_id=dde465001c014ec191442ea47868c4db)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:46:32.426819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:46:32.426819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:46:32.426819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:46:32.428015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:46:32.562463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dde465001c014ec191442ea47868c4db', 'request_id': 'req-de26caf4-e933-41d3-8045-26199225abff'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:32.576461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dde465001c014ec191442ea47868c4db', 'request_id': 'req-de26caf4-e933-41d3-8045-26199225abff'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:32.644406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dde465001c014ec191442ea47868c4db', 'request_id': 'req-de26caf4-e933-41d3-8045-26199225abff'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:32.668597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] The token cache is being invalidate because project dde465001c014ec191442ea47868c4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:46:32.668890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:32.669322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-de26caf4-e933-41d3-8045-26199225abff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:46:32.670719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 753/1510] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:46:32 2022] DELETE /identity/v3/projects/dde465001c014ec191442ea47868c4db => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:46:41.856943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=62 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:46:42.666388 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:07.691625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9876b-0d3f-4158-85d3-5a2f7b6f915f None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:07.692233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9876b-0d3f-4158-85d3-5a2f7b6f915f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:07.692233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9876b-0d3f-4158-85d3-5a2f7b6f915f None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:07.693599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:07.698267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99302dd-afdd-4a79-b61f-0beff0da5454 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:07.698714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99302dd-afdd-4a79-b61f-0beff0da5454 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:07.698850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99302dd-afdd-4a79-b61f-0beff0da5454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:07.778491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f99302dd-afdd-4a79-b61f-0beff0da5454 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:07.779701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f99302dd-afdd-4a79-b61f-0beff0da5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:07.883005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:08.035938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9876b-0d3f-4158-85d3-5a2f7b6f915f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:08.043003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4ed9876b-0d3f-4158-85d3-5a2f7b6f915f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:08.155779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9876b-0d3f-4158-85d3-5a2f7b6f915f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:08.161386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aad2c6-6451-4b16-aca3-394fe2b61697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:08.162006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad2c6-6451-4b16-aca3-394fe2b61697 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:08.162296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad2c6-6451-4b16-aca3-394fe2b61697 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:08.162585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad2c6-6451-4b16-aca3-394fe2b61697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:08.170826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aad2c6-6451-4b16-aca3-394fe2b61697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:08.172452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aad2c6-6451-4b16-aca3-394fe2b61697 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:08.181731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 759/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:48:09.012837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f05ba-bcc7-402b-86cb-5d6a8c9b9b60 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:09.013309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f05ba-bcc7-402b-86cb-5d6a8c9b9b60 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:09.013418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f05ba-bcc7-402b-86cb-5d6a8c9b9b60 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:09.014720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:09.019605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bbed-0549-4998-966d-f33ab4856148 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:09.019999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bbed-0549-4998-966d-f33ab4856148 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:09.020167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114bbed-0549-4998-966d-f33ab4856148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:09.039340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e114bbed-0549-4998-966d-f33ab4856148 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:09.041408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e114bbed-0549-4998-966d-f33ab4856148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:09.051478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:09.203502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f05ba-bcc7-402b-86cb-5d6a8c9b9b60 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:09.217694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f05ba-bcc7-402b-86cb-5d6a8c9b9b60 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:09.223641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ef808-670f-453f-9fb3-35a9cb42319e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:09.224272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef808-670f-453f-9fb3-35a9cb42319e service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:09.224556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef808-670f-453f-9fb3-35a9cb42319e service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:09.224830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef808-670f-453f-9fb3-35a9cb42319e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:09.232876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef808-670f-453f-9fb3-35a9cb42319e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:09.234497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ef808-670f-453f-9fb3-35a9cb42319e service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:09.245671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 756/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:48:09.359521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516356e0-7b9a-43fa-8e9f-62fbe7d140c2 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:09.359838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516356e0-7b9a-43fa-8e9f-62fbe7d140c2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:09.360120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516356e0-7b9a-43fa-8e9f-62fbe7d140c2 None None] PATH_INFO: `/v3` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:09.361441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 761/1517] 10.222.0.17 () {54 vars in 925 bytes} [Mon Aug 22 05:48:09 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:48:09.371662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62864-9036-4f82-91e5-647fb5248362 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:09.371959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62864-9036-4f82-91e5-647fb5248362 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:09.372270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b62864-9036-4f82-91e5-647fb5248362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:09.430819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-67b62864-9036-4f82-91e5-647fb5248362 None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:09.432011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-67b62864-9036-4f82-91e5-647fb5248362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:09.448280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:09.503144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 757/1518] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Aug 22 05:48:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:13.494832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbbcb-512f-498a-aa75-5ca86d33b6db None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:13.495315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbbcb-512f-498a-aa75-5ca86d33b6db None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:13.495315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcbbcb-512f-498a-aa75-5ca86d33b6db None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:13.496739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 762/1519] 10.222.0.27 () {54 vars in 961 bytes} [Mon Aug 22 05:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:13.501532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e848-7818-448d-8710-398dbb8f6f16 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:13.502507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e848-7818-448d-8710-398dbb8f6f16 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:13.502620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5e848-7818-448d-8710-398dbb8f6f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:13.521844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4ba5e848-7818-448d-8710-398dbb8f6f16 None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:13.523024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4ba5e848-7818-448d-8710-398dbb8f6f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:13.531569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 758/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Aug 22 05:48:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:13.538931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcbbcb-512f-498a-aa75-5ca86d33b6db None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:13.551891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcbbcb-512f-498a-aa75-5ca86d33b6db None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:13.556723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436d60e-c26f-4741-b6f8-1f7f7f29369e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:13.557302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436d60e-c26f-4741-b6f8-1f7f7f29369e service placement] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:13.557582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436d60e-c26f-4741-b6f8-1f7f7f29369e service placement] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:13.557879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436d60e-c26f-4741-b6f8-1f7f7f29369e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:13.566427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436d60e-c26f-4741-b6f8-1f7f7f29369e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:13.567988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436d60e-c26f-4741-b6f8-1f7f7f29369e service placement] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:13.577252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 763/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:48:20.464001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4abcf-7350-4358-82a4-7e54e61c0715 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:20.464637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4abcf-7350-4358-82a4-7e54e61c0715 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:20.464637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4abcf-7350-4358-82a4-7e54e61c0715 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:20.465990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:20.470820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc55d-b2a9-4d71-81ea-25f0480983ce None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:20.471268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc55d-b2a9-4d71-81ea-25f0480983ce None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:20.471371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fbc55d-b2a9-4d71-81ea-25f0480983ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:20.491234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-30fbc55d-b2a9-4d71-81ea-25f0480983ce None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:20.492451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-30fbc55d-b2a9-4d71-81ea-25f0480983ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:20.500080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:20.652959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4abcf-7350-4358-82a4-7e54e61c0715 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:20.667467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4abcf-7350-4358-82a4-7e54e61c0715 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:20.672892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde122a6-381b-418d-b754-a124f4a8039c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:20.673480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde122a6-381b-418d-b754-a124f4a8039c service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:20.673762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde122a6-381b-418d-b754-a124f4a8039c service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:20.674039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde122a6-381b-418d-b754-a124f4a8039c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:20.682379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde122a6-381b-418d-b754-a124f4a8039c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:20.683961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde122a6-381b-418d-b754-a124f4a8039c service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:20.693200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 760/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:48:21.513222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b865-6dda-439a-9aa7-73056ab9b0be None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:21.513769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b865-6dda-439a-9aa7-73056ab9b0be None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:21.513769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2b865-6dda-439a-9aa7-73056ab9b0be None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:21.515138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 22 05:48:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:21.520118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e822f8-a54f-4ada-bbd1-cb7ccf279afd None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:21.520569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e822f8-a54f-4ada-bbd1-cb7ccf279afd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:21.520730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e822f8-a54f-4ada-bbd1-cb7ccf279afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:21.541270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-55e822f8-a54f-4ada-bbd1-cb7ccf279afd None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:21.542467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-55e822f8-a54f-4ada-bbd1-cb7ccf279afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:21.551199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 22 05:48:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:21.702524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b865-6dda-439a-9aa7-73056ab9b0be None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:21.717234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2b865-6dda-439a-9aa7-73056ab9b0be None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:21.723280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fc378-5896-4060-96e2-8ca0948be47b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:21.723871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc378-5896-4060-96e2-8ca0948be47b service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:21.724153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc378-5896-4060-96e2-8ca0948be47b service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:21.724452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fc378-5896-4060-96e2-8ca0948be47b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:21.732348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fc378-5896-4060-96e2-8ca0948be47b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:21.733924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fc378-5896-4060-96e2-8ca0948be47b service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:21.743074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 766/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:48:25.586056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58d3c0-c7ac-4130-a150-8a3c85f18bb5 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:25.586582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58d3c0-c7ac-4130-a150-8a3c85f18bb5 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:25.586582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58d3c0-c7ac-4130-a150-8a3c85f18bb5 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:25.587917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:25.593343 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c389b-5aa7-42d1-83a2-7c537957cde7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:25.593807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c389b-5aa7-42d1-83a2-7c537957cde7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:25.593912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c389b-5aa7-42d1-83a2-7c537957cde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:25.613231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4b2c389b-5aa7-42d1-83a2-7c537957cde7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:25.614435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4b2c389b-5aa7-42d1-83a2-7c537957cde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:25.622120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:25.910794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58d3c0-c7ac-4130-a150-8a3c85f18bb5 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:25.912606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ff58d3c0-c7ac-4130-a150-8a3c85f18bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:25.988548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58d3c0-c7ac-4130-a150-8a3c85f18bb5 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:25.992085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba39fb3-94d2-4474-93a0-9b9b76e6e600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:25.992711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba39fb3-94d2-4474-93a0-9b9b76e6e600 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:25.992991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba39fb3-94d2-4474-93a0-9b9b76e6e600 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:25.993270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba39fb3-94d2-4474-93a0-9b9b76e6e600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:26.001972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba39fb3-94d2-4474-93a0-9b9b76e6e600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:26.003927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba39fb3-94d2-4474-93a0-9b9b76e6e600 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:26.013114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 763/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:48:27.872537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bbb5e-233d-46ff-ae2d-014b04642dbd None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:27.873099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bbb5e-233d-46ff-ae2d-014b04642dbd None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:27.873099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bbb5e-233d-46ff-ae2d-014b04642dbd None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:27.874438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:27.880417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5060-68e1-46bd-8861-fd03a441edca None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:27.880843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5060-68e1-46bd-8861-fd03a441edca None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:27.880984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d5060-68e1-46bd-8861-fd03a441edca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:27.899883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c43d5060-68e1-46bd-8861-fd03a441edca None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:27.901171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c43d5060-68e1-46bd-8861-fd03a441edca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:27.908976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:48:28.190473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bbb5e-233d-46ff-ae2d-014b04642dbd None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:28.201223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bbb5e-233d-46ff-ae2d-014b04642dbd None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:28.204714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e62826b-0712-4478-9b23-1a51092ca19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:28.205308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62826b-0712-4478-9b23-1a51092ca19e service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:28.205622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62826b-0712-4478-9b23-1a51092ca19e service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:28.205903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62826b-0712-4478-9b23-1a51092ca19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:28.214874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62826b-0712-4478-9b23-1a51092ca19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:28.216414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e62826b-0712-4478-9b23-1a51092ca19e service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:28.226151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 769/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:48:31.694390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75ee9-f815-4961-a9a8-2d35eaffc47e None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:31.694974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75ee9-f815-4961-a9a8-2d35eaffc47e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:31.694974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75ee9-f815-4961-a9a8-2d35eaffc47e None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:31.696326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:31.701504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ed69-ee32-472a-b1f3-fa87de0088c5 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:31.701959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ed69-ee32-472a-b1f3-fa87de0088c5 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:31.702084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ed69-ee32-472a-b1f3-fa87de0088c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:31.721317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6266ed69-ee32-472a-b1f3-fa87de0088c5 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:31.723021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6266ed69-ee32-472a-b1f3-fa87de0088c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:31.730805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:32.284134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75ee9-f815-4961-a9a8-2d35eaffc47e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:32.288698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-dec75ee9-f815-4961-a9a8-2d35eaffc47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:32.349946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:32.363311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75ee9-f815-4961-a9a8-2d35eaffc47e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:32.366950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5bf45-d6b1-4cfc-95fb-aa8f9a6afd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:32.367558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5bf45-d6b1-4cfc-95fb-aa8f9a6afd90 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:32.367869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5bf45-d6b1-4cfc-95fb-aa8f9a6afd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:32.368149 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5bf45-d6b1-4cfc-95fb-aa8f9a6afd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:32.377041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5bf45-d6b1-4cfc-95fb-aa8f9a6afd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:32.379265 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5bf45-d6b1-4cfc-95fb-aa8f9a6afd90 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:32.388463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 766/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:48:34.282990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf025-5127-4bbe-b6b8-fccaba52d827 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:34.283529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf025-5127-4bbe-b6b8-fccaba52d827 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:34.283625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcf025-5127-4bbe-b6b8-fccaba52d827 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:34.284962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 22 05:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:48:34.290452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa07cc-8c01-4bfa-b2ef-7b11dc0edde4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:34.290880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa07cc-8c01-4bfa-b2ef-7b11dc0edde4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:34.291019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa07cc-8c01-4bfa-b2ef-7b11dc0edde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:34.310571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-16fa07cc-8c01-4bfa-b2ef-7b11dc0edde4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:48:34.311765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-16fa07cc-8c01-4bfa-b2ef-7b11dc0edde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:34.320120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 22 05:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:48:34.877295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf025-5127-4bbe-b6b8-fccaba52d827 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:48:34.879531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-79dcf025-5127-4bbe-b6b8-fccaba52d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:48:34.887205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=84 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:34.892994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcf025-5127-4bbe-b6b8-fccaba52d827 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:48:34.897201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50781701-3c5a-4c04-953d-5d083fba2340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:48:34.897830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781701-3c5a-4c04-953d-5d083fba2340 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:48:34.898115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781701-3c5a-4c04-953d-5d083fba2340 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:48:34.898398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50781701-3c5a-4c04-953d-5d083fba2340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:48:34.907154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50781701-3c5a-4c04-953d-5d083fba2340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:48:34.908629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50781701-3c5a-4c04-953d-5d083fba2340 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:48:34.917845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 772/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:48:44.305843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=11 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:48:44.931165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:03.044637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5f40-e2a4-4d06-85f1-14343fc44c65 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.045827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5f40-e2a4-4d06-85f1-14343fc44c65 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.045827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc5f40-e2a4-4d06-85f1-14343fc44c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.072163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-96cc5f40-e2a4-4d06-85f1-14343fc44c65 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.073623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-96cc5f40-e2a4-4d06-85f1-14343fc44c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.087754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 768/1540] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.097116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9afe-2a4f-43d8-aa56-6e57e65e7e8e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.097692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9afe-2a4f-43d8-aa56-6e57e65e7e8e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.097692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf9afe-2a4f-43d8-aa56-6e57e65e7e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.126285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0bcf9afe-2a4f-43d8-aa56-6e57e65e7e8e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.127486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0bcf9afe-2a4f-43d8-aa56-6e57e65e7e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.139388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 773/1541] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.144652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5f40-e2a4-4d06-85f1-14343fc44c65 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.162625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc5f40-e2a4-4d06-85f1-14343fc44c65 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.177945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.177945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.177945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.177945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.178444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:03.178444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.178444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.195208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 769/1542] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:03.204035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf9afe-2a4f-43d8-aa56-6e57e65e7e8e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.219589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf9afe-2a4f-43d8-aa56-6e57e65e7e8e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.228360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab55a78-edf3-46a7-90e1-1ea963222e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.228996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55a78-edf3-46a7-90e1-1ea963222e7f admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.229279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55a78-edf3-46a7-90e1-1ea963222e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.229555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab55a78-edf3-46a7-90e1-1ea963222e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.230199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55a78-edf3-46a7-90e1-1ea963222e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.232122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab55a78-edf3-46a7-90e1-1ea963222e7f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.358735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 774/1543] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:03.362778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.378189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b365da-1573-444c-87d5-012aa3092839 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.400434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37450-c85e-400f-8e5e-5594c49b4c84 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.400753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37450-c85e-400f-8e5e-5594c49b4c84 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.401004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37450-c85e-400f-8e5e-5594c49b4c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.423192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-eef37450-c85e-400f-8e5e-5594c49b4c84 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.424447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-eef37450-c85e-400f-8e5e-5594c49b4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.461732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5165bf-11e2-4ae6-ac0d-8f1e76cd4930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.462269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5165bf-11e2-4ae6-ac0d-8f1e76cd4930 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.462551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5165bf-11e2-4ae6-ac0d-8f1e76cd4930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.463066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5165bf-11e2-4ae6-ac0d-8f1e76cd4930 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.463712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5165bf-11e2-4ae6-ac0d-8f1e76cd4930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.465982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5165bf-11e2-4ae6-ac0d-8f1e76cd4930 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.544752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 775/1544] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.547124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709c81-5b70-4e23-9c38-7fd7d0085778 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.547643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709c81-5b70-4e23-9c38-7fd7d0085778 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.548147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c709c81-5b70-4e23-9c38-7fd7d0085778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.586680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5c709c81-5b70-4e23-9c38-7fd7d0085778 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.588420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5c709c81-5b70-4e23-9c38-7fd7d0085778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.596176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 770/1545] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:03.599535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f970ef-0b38-4e7e-b3d3-047a06d6def1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.599820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f970ef-0b38-4e7e-b3d3-047a06d6def1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.600106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f970ef-0b38-4e7e-b3d3-047a06d6def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.607550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 776/1546] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.610958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c709c81-5b70-4e23-9c38-7fd7d0085778 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.621939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c709c81-5b70-4e23-9c38-7fd7d0085778 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.632535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-56f970ef-0b38-4e7e-b3d3-047a06d6def1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.633769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-56f970ef-0b38-4e7e-b3d3-047a06d6def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.635205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559712a6-d8a0-47e4-9cb1-8773aff44719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.636286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559712a6-d8a0-47e4-9cb1-8773aff44719 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.636791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559712a6-d8a0-47e4-9cb1-8773aff44719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.637280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559712a6-d8a0-47e4-9cb1-8773aff44719 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.638225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559712a6-d8a0-47e4-9cb1-8773aff44719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.641470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559712a6-d8a0-47e4-9cb1-8773aff44719 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.651943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 771/1547] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.653460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978b94-609a-4d3e-9c2d-fde349af7b32 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.653749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978b94-609a-4d3e-9c2d-fde349af7b32 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.654027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed978b94-609a-4d3e-9c2d-fde349af7b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.662920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 777/1548] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:03.667249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119335c-b166-4265-a7ce-f61cac440c22 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.667570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119335c-b166-4265-a7ce-f61cac440c22 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.667820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119335c-b166-4265-a7ce-f61cac440c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.694438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ed978b94-609a-4d3e-9c2d-fde349af7b32 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.697138 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ed978b94-609a-4d3e-9c2d-fde349af7b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.716079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-7119335c-b166-4265-a7ce-f61cac440c22 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.718190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7119335c-b166-4265-a7ce-f61cac440c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.719745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 772/1549] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.720988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978b94-609a-4d3e-9c2d-fde349af7b32 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.734312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 778/1550] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.737095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119335c-b166-4265-a7ce-f61cac440c22 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.739469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed978b94-609a-4d3e-9c2d-fde349af7b32 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.752024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96518b1a-48c8-44f5-bfb8-8a937f753847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.753029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518b1a-48c8-44f5-bfb8-8a937f753847 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.753517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518b1a-48c8-44f5-bfb8-8a937f753847 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.754017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96518b1a-48c8-44f5-bfb8-8a937f753847 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.754898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96518b1a-48c8-44f5-bfb8-8a937f753847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:03.756310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96518b1a-48c8-44f5-bfb8-8a937f753847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.757991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96518b1a-48c8-44f5-bfb8-8a937f753847 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.758286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119335c-b166-4265-a7ce-f61cac440c22 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.771472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 773/1551] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:03.772535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.772847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345804e-f1ed-42ef-8379-c7e015579193 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.773174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345804e-f1ed-42ef-8379-c7e015579193 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.773453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345804e-f1ed-42ef-8379-c7e015579193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.774198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.774703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.775196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.776062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.778067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.790103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 779/1552] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:03.791379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.794072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b345804e-f1ed-42ef-8379-c7e015579193 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.795309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b345804e-f1ed-42ef-8379-c7e015579193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.801450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457094-014d-4524-95c6-462c91a5a93e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.803539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 774/1553] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.804834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4084fae-b04e-43e3-8310-306047f04670 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.805362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4084fae-b04e-43e3-8310-306047f04670 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.805362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4084fae-b04e-43e3-8310-306047f04670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.808203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.808888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.809173 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.809451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.810101 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:03.810408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.811460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING py.warnings [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:50:03.811460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: warnings.warn(msg) Aug 22 05:50:03.811460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: Aug 22 05:50:03.812368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e69795-6dcb-41e0-8e22-5b8a7c786338 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.825886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a4084fae-b04e-43e3-8310-306047f04670 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.826729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 780/1554] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:03.831227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a4084fae-b04e-43e3-8310-306047f04670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.831389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2e55-29b2-425e-bc84-3f40c53e9863 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.831389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2e55-29b2-425e-bc84-3f40c53e9863 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.831389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2e55-29b2-425e-bc84-3f40c53e9863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.844346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 775/1555] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.845081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4084fae-b04e-43e3-8310-306047f04670 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.849785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a0bc2e55-29b2-425e-bc84-3f40c53e9863 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.850965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a0bc2e55-29b2-425e-bc84-3f40c53e9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.854560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4084fae-b04e-43e3-8310-306047f04670 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.858824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 781/1556] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.859055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a38ee-62da-4aff-9206-714db9e4fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.859642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a38ee-62da-4aff-9206-714db9e4fcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.859983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a38ee-62da-4aff-9206-714db9e4fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.860117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c3404-4b25-45b6-bfcd-a3a01bd90936 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.860348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a38ee-62da-4aff-9206-714db9e4fcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.860463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c3404-4b25-45b6-bfcd-a3a01bd90936 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.860667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c3404-4b25-45b6-bfcd-a3a01bd90936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.860904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a38ee-62da-4aff-9206-714db9e4fcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.861924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-f16a38ee-62da-4aff-9206-714db9e4fcb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:50:03.861924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:50:03.861924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:50:03.863114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a38ee-62da-4aff-9206-714db9e4fcb1 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.879521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-df9c3404-4b25-45b6-bfcd-a3a01bd90936 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.880727 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-df9c3404-4b25-45b6-bfcd-a3a01bd90936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.889114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 782/1557] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:03.889838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c3404-4b25-45b6-bfcd-a3a01bd90936 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:03.899394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c3404-4b25-45b6-bfcd-a3a01bd90936 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:03.904042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:03.905362 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.905649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.905928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] PATH_INFO: `/v3/projects/618a763b43164bcea96d5b735162d38f/users/d7d7577ea743410ca308f62b04e7cf58/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.919893 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618a763b43164bcea96d5b735162d38f, user_id=d7d7577ea743410ca308f62b04e7cf58, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:03.922571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:03.969481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 776/1558] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:03.970661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771515-aa79-4ce8-953e-bb3459d793b4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:03.970952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771515-aa79-4ce8-953e-bb3459d793b4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:03.971228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6771515-aa79-4ce8-953e-bb3459d793b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:03.990525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b6771515-aa79-4ce8-953e-bb3459d793b4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:03.991713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b6771515-aa79-4ce8-953e-bb3459d793b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:03.996914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 783/1559] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:03 2022] PUT /identity/v3/projects/618a763b43164bcea96d5b735162d38f/users/d7d7577ea743410ca308f62b04e7cf58/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:03.997752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.039187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:04.056017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 777/1560] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:04.057607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceff5-8ed2-4c54-b857-faa59d890137 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.062851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceff5-8ed2-4c54-b857-faa59d890137 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.062851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ceff5-8ed2-4c54-b857-faa59d890137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.063049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7c45e-c28e-4b45-b606-4ad693004c44 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.064878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.065492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.065779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.066062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.066699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.068740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.078094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-490ceff5-8ed2-4c54-b857-faa59d890137 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:04.079276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-490ceff5-8ed2-4c54-b857-faa59d890137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:04.087790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 778/1561] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:04.089085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ceff5-8ed2-4c54-b857-faa59d890137 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.093454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:04.098502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ceff5-8ed2-4c54-b857-faa59d890137 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.103079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b162249-eb13-43bf-861d-9c7a2fbb1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.103657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162249-eb13-43bf-861d-9c7a2fbb1c1d admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.103942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162249-eb13-43bf-861d-9c7a2fbb1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.104270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b162249-eb13-43bf-861d-9c7a2fbb1c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.104916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162249-eb13-43bf-861d-9c7a2fbb1c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:04.105222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162249-eb13-43bf-861d-9c7a2fbb1c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.106817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b162249-eb13-43bf-861d-9c7a2fbb1c1d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.117888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 779/1562] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:04.119003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c3b0-6a83-4640-a417-577d48d4e51a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.119288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c3b0-6a83-4640-a417-577d48d4e51a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.119566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f9c3b0-6a83-4640-a417-577d48d4e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.138185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-70f9c3b0-6a83-4640-a417-577d48d4e51a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:04.148016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-70f9c3b0-6a83-4640-a417-577d48d4e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:04.148016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 780/1563] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:04.148896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b1c6f-b3b2-4d62-b3ef-c4251052d2ae None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.149183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b1c6f-b3b2-4d62-b3ef-c4251052d2ae None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.149459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b1c6f-b3b2-4d62-b3ef-c4251052d2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.167296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-745b1c6f-b3b2-4d62-b3ef-c4251052d2ae None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:04.168442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-745b1c6f-b3b2-4d62-b3ef-c4251052d2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:04.172511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 784/1564] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:03 2022] POST /identity/v3/projects => generated 357 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.173327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.181538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 781/1565] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:04.181538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a2bd-fbe2-48b1-9ffd-21fa43c0be25 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.181538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a2bd-fbe2-48b1-9ffd-21fa43c0be25 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.181538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6a2bd-fbe2-48b1-9ffd-21fa43c0be25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.199132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f7c6a2bd-fbe2-48b1-9ffd-21fa43c0be25 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:04.200355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f7c6a2bd-fbe2-48b1-9ffd-21fa43c0be25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:04.239005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651f4a3-d859-4577-a8b4-449e9d0c1c1a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.243585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.244211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.244500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.244774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.245396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.246444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING py.warnings [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:50:04.246444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: warnings.warn(msg) Aug 22 05:50:04.246444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: Aug 22 05:50:04.247654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.258058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 782/1566] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:04.258900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6a2bd-fbe2-48b1-9ffd-21fa43c0be25 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.268691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6a2bd-fbe2-48b1-9ffd-21fa43c0be25 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.273308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58b16a-7fa7-4eed-b2fd-81ff069ded41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.273902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58b16a-7fa7-4eed-b2fd-81ff069ded41 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.274204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58b16a-7fa7-4eed-b2fd-81ff069ded41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.274464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58b16a-7fa7-4eed-b2fd-81ff069ded41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.275106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58b16a-7fa7-4eed-b2fd-81ff069ded41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:04.275415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58b16a-7fa7-4eed-b2fd-81ff069ded41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.277051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58b16a-7fa7-4eed-b2fd-81ff069ded41 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.288427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 783/1567] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:04.291849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a489b-e036-4c44-b349-81459a51928d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.291849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a489b-e036-4c44-b349-81459a51928d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.291849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a489b-e036-4c44-b349-81459a51928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.309489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a48a489b-e036-4c44-b349-81459a51928d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:04.311261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a48a489b-e036-4c44-b349-81459a51928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:04.319356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 784/1568] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:04.320090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a489b-e036-4c44-b349-81459a51928d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.329150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a489b-e036-4c44-b349-81459a51928d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.334041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.334612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.334896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.335179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.335791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.337715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.340220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 785/1569] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.341136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.350899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb8503-4018-4f2f-b7ae-fbfd3e3c4da2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.355746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.356402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.356685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.356963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.358125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:04.358429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.360033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.373927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 786/1570] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:04.374748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.383959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb47f2-5917-4754-a90d-8365ea5ecd9a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.388503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.389069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.389353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.389627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.390225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.392104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.428812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 785/1571] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.428812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.487193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c1f4d-7005-40d0-8df9-099f057f7f76 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.491790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.492359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.492642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.492914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.493546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:04.493847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.495431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.506501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 787/1572] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/users => generated 279 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.506501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.510232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 786/1573] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:04.512036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.520894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b83402-6d84-4a34-a307-2a114eb2700a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.525880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.526462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.526742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.527020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.527633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.529584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.560132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71820fb4-59bc-438b-aecc-23bf206978a8 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.592983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:04.608176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.608823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.609105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.609491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.618201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.619659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.629416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 788/1574] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:04.630191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.639235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20237a-3e5f-4fcb-886a-4c56e56e6a06 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.642145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 787/1575] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.643071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.654881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:04.698443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.699043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.699324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.699600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.700268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:04.700609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.702261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.706310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f78e7a-89e5-4204-9dde-52a18c9af0e6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.711270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.712755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.712755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.712755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.713217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.721511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 789/1576] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:04.721511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.721786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.724995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e9229-c566-46c1-8632-11dad85cee8a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.728459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 788/1577] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:04.728459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.729845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.730530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.730707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.730986 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.731737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.734268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.736724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5597d60-4aa8-4d7e-90e4-6e7994fb5c13 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.741185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.748600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.748600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.748600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.748600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.748600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.826536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 790/1578] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.827552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.888537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 789/1579] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.889476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.891548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e8a88-3edc-43ae-829e-010f5ec8c9c2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.897292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.897977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.898356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.898675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.899360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.900431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df744de-34c5-4d0e-bbf7-4c9a2bf599ad admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.901279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.905966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.906564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.906856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.907246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.907766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.910039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.922589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 791/1580] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:04.922589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:04.937681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359cd51-40df-412c-9073-67d39a32f8af admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:04.942392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:04.943654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:04.943654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:04.943654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:04.944180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:04.946171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:04.993894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 790/1581] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:04.994574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.019895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 792/1582] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:05.021749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.034111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a58b7-42c2-42dc-bfd9-5a3bb003694f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.061261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd986a-9526-48f9-b9ef-86553d5fc4db admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.065620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:05.066140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.066759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.067044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.067320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.067954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.069985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.094389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.095040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.095322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.095596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.096274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.097857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.107474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 793/1583] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.108302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.118164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73e27d-16cc-4604-926d-2bffc13f48b6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.123527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.124145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.124473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.125292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.125905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.127839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.155967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 791/1584] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:04 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:05.155967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.203608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:05.218011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b65965-17f6-40c4-a8f0-6d3cb3da383b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.222633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.223247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.223609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.223906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.224582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.226256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.239349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 794/1585] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:05 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:05.239349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.248849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 792/1586] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.249886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.254930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61a3a-63db-472a-94f6-ab3de91ff58d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.261671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94a04d-db89-4fae-a768-08b4f5b62d50 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.264066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.264066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.264066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.264066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.264465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.265864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.266981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.267587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.267872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.268154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.268807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.270743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.276155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 795/1587] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.276976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.287556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965eda-d913-42fb-b1f7-74890f07121a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.292221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.292772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.293056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.293337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.293980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.295617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.306230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 796/1588] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.306997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.316425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceca481-b049-4c64-ae04-496a927ec67a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.320943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.321545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.321830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.322110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] PATH_INFO: `/v3/projects/d40084384bad48eab73de0baafc0836d/users/190c69a502cf4f0ca8eb1de49bd86888/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.337083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40084384bad48eab73de0baafc0836d, user_id=190c69a502cf4f0ca8eb1de49bd86888, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.339699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.374229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 793/1589] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:05 2022] POST /identity/v3/users => generated 291 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:05.374930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.386911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97d0a9-df07-4d74-b890-694b569671ea admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.392171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.392813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.393096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.393377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.393998 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.395913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.414391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 797/1590] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:05 2022] PUT /identity/v3/projects/d40084384bad48eab73de0baafc0836d/users/190c69a502cf4f0ca8eb1de49bd86888/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:05.415229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.478454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 794/1591] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:05 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:05.479809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.482529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8ee11-ebc6-493c-8184-95ca4b82e1cf admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.487326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.487933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.488371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.488786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.489443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.491076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.491266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ec07-c7f8-42a0-9bab-6435ef2eb6b9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.498988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.499608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.499902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.500162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.500978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.502132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 798/1592] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.502880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.506343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.515203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9e372-b3f5-4a1a-92b7-44589bbfcd48 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.519050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 795/1593] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.519967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.523688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.524389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.524673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.524978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] PATH_INFO: `/v3/projects/d96a2fd3e8444a29af3ef0ceb38f3f9e/users/46c1aed4791740dea2fc1369a9c77b9a/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.529939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed0a46-f825-4efe-b851-bd574d0d7b72 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.537008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.537599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.537879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.538158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.538812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.539970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96a2fd3e8444a29af3ef0ceb38f3f9e, user_id=46c1aed4791740dea2fc1369a9c77b9a, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.540410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.542683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.551370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 796/1594] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.552157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.561848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7ab58-be78-4fd4-9767-cdb30e4acd18 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.566625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f295b-a1b8-418d-a109-050f4397b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.567205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f295b-a1b8-418d-a109-050f4397b2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.567488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f295b-a1b8-418d-a109-050f4397b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.567767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f295b-a1b8-418d-a109-050f4397b2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.568424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f295b-a1b8-418d-a109-050f4397b2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.569977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1f295b-a1b8-418d-a109-050f4397b2b1 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.580770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 797/1595] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.582977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fface-b551-4039-8e30-3a873f3f5b34 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.583409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fface-b551-4039-8e30-3a873f3f5b34 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.584010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397fface-b551-4039-8e30-3a873f3f5b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.602689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-397fface-b551-4039-8e30-3a873f3f5b34 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:05.603902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-397fface-b551-4039-8e30-3a873f3f5b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:05.612302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 798/1596] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:05.613033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fface-b551-4039-8e30-3a873f3f5b34 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.623678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397fface-b551-4039-8e30-3a873f3f5b34 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.637382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 799/1597] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:05 2022] PUT /identity/v3/projects/d96a2fd3e8444a29af3ef0ceb38f3f9e/users/46c1aed4791740dea2fc1369a9c77b9a/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:05.639214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.682565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.683174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.683456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.683729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.684396 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.686652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.688033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:05.696728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 799/1598] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.697591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.709331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831be8-de63-49cd-a731-4f264306ce5d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.715158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ada1d-fc98-456c-afdf-db4748d9d261 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.715289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.715289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.715289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.715289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] PATH_INFO: `/v3/projects/cf898d694468485390bd3ea470cb978b/users/fee118f5f48f43329138d815d951d212/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.717389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.718003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.718289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.718565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.719214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.720961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.729481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf898d694468485390bd3ea470cb978b, user_id=fee118f5f48f43329138d815d951d212, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.730502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:50:05.730502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:50:05.730502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:50:05.731377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 800/1599] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.732161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.735615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.743005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669991d7-83fa-4387-860e-ad233370fdd1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.747555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b205f-ad2b-494d-98c3-13765ddb88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.749490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b205f-ad2b-494d-98c3-13765ddb88dd admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.749490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b205f-ad2b-494d-98c3-13765ddb88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.749490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b205f-ad2b-494d-98c3-13765ddb88dd admin admin] PATH_INFO: `/v3/projects/e9d8a7f6afec4b548ad6ddcf288d6835/users/cae765348a434c4e8cdf46690bb5a167/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.763424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b205f-ad2b-494d-98c3-13765ddb88dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9d8a7f6afec4b548ad6ddcf288d6835, user_id=cae765348a434c4e8cdf46690bb5a167, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.766735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b205f-ad2b-494d-98c3-13765ddb88dd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.811691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 800/1600] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:05 2022] PUT /identity/v3/projects/cf898d694468485390bd3ea470cb978b/users/fee118f5f48f43329138d815d951d212/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:05.812652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.860141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:05.878022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3848b-d326-4dc1-a1dd-0271375950cd admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:05.882917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:05.883535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.884097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.884097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.884758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:05.886360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:05.896731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 801/1601] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:05.897832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:05.899766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:05.916690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 801/1602] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:05 2022] PUT /identity/v3/projects/e9d8a7f6afec4b548ad6ddcf288d6835/users/cae765348a434c4e8cdf46690bb5a167/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:05.919000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05888-6020-416e-a15c-e5f98edeaa1e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:05.920357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05888-6020-416e-a15c-e5f98edeaa1e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:05.921149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc05888-6020-416e-a15c-e5f98edeaa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:05.962715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-efc05888-6020-416e-a15c-e5f98edeaa1e None None] MFA Rules not processed for user `46c1aed4791740dea2fc1369a9c77b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:05.964626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-efc05888-6020-416e-a15c-e5f98edeaa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:05.971840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0698-0370-42d0-a2ed-746c76fba25b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.031442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:06.032776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.034072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.034072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.040789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 802/1603] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:06.041816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc05888-6020-416e-a15c-e5f98edeaa1e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.106548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:06.109223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:06.121955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 802/1604] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:06.122665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.125566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc05888-6020-416e-a15c-e5f98edeaa1e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.131915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304290a3-ce72-4114-8e6c-7e13ac3a1868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:06.132814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304290a3-ce72-4114-8e6c-7e13ac3a1868 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.133204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304290a3-ce72-4114-8e6c-7e13ac3a1868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.133574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304290a3-ce72-4114-8e6c-7e13ac3a1868 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.134285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f8c01-1e0a-427a-b7ed-b88dc63b032e service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.134412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304290a3-ce72-4114-8e6c-7e13ac3a1868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:06.136911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304290a3-ce72-4114-8e6c-7e13ac3a1868 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:06.139926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:06.140534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.140885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.141249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] PATH_INFO: `/v3/projects/ce5100ee15654ff7a3510fc8bd6d99b9/users/a844362c07764ff9b43719573f6cdbbb/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.155429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 803/1605] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:06.155429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff388ba-ad47-4c97-89e9-58e1a5b06e2f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.155429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff388ba-ad47-4c97-89e9-58e1a5b06e2f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.155429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff388ba-ad47-4c97-89e9-58e1a5b06e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.163311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5100ee15654ff7a3510fc8bd6d99b9, user_id=a844362c07764ff9b43719573f6cdbbb, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:06.167857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:06.188586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5ff388ba-ad47-4c97-89e9-58e1a5b06e2f None None] MFA Rules not processed for user `fee118f5f48f43329138d815d951d212`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:06.189926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5ff388ba-ad47-4c97-89e9-58e1a5b06e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:06.213194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:06.265480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 803/1606] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:06 2022] PUT /identity/v3/projects/ce5100ee15654ff7a3510fc8bd6d99b9/users/a844362c07764ff9b43719573f6cdbbb/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:06.265480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.304849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 804/1607] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:06.310378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa50e0-154b-4440-ac9b-6216565f3885 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.310669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa50e0-154b-4440-ac9b-6216565f3885 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.311547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa50e0-154b-4440-ac9b-6216565f3885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.327926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:06.343290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e2fa50e0-154b-4440-ac9b-6216565f3885 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:06.344729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e2fa50e0-154b-4440-ac9b-6216565f3885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:06.405091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69724a6-3ebe-4b15-ab43-cde3e61d1f19 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.412370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:06.413611 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.414144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.414613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] PATH_INFO: `/v3/projects/a457b7ad8fab4b62a2a173c9e9e1d1d9/users/49964c052c47422b80bd03c724052019/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.417745 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 805/1608] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:06.421622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa50e0-154b-4440-ac9b-6216565f3885 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.428917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa50e0-154b-4440-ac9b-6216565f3885 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.435153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6bc6a-d232-4075-a90c-c9039bde4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:06.435153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bc6a-d232-4075-a90c-c9039bde4e83 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.435496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bc6a-d232-4075-a90c-c9039bde4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.436009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6bc6a-d232-4075-a90c-c9039bde4e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.436572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6bc6a-d232-4075-a90c-c9039bde4e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:06.438730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6bc6a-d232-4075-a90c-c9039bde4e83 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:06.445373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a457b7ad8fab4b62a2a173c9e9e1d1d9, user_id=49964c052c47422b80bd03c724052019, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:06.446329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:06.526448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 804/1609] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:06 2022] PUT /identity/v3/projects/a457b7ad8fab4b62a2a173c9e9e1d1d9/users/49964c052c47422b80bd03c724052019/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:06.531144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.540229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 806/1610] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:06 2022] POST /identity/v3/projects => generated 357 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:06.541523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f58310-95bd-431c-9df8-09291b88d0a5 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.541916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f58310-95bd-431c-9df8-09291b88d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.542299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f58310-95bd-431c-9df8-09291b88d0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.563619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d0f58310-95bd-431c-9df8-09291b88d0a5 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:06.565240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d0f58310-95bd-431c-9df8-09291b88d0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:06.609752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1b68e-b045-4b7e-a738-7dba1d9bb15e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.651467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 807/1611] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:06.652863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2634ec-dae4-44c7-a587-8964755bae38 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.653175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2634ec-dae4-44c7-a587-8964755bae38 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.653585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2634ec-dae4-44c7-a587-8964755bae38 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.662233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 808/1612] 10.222.0.27 () {54 vars in 962 bytes} [Mon Aug 22 05:50:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:50:06.662952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2634ec-dae4-44c7-a587-8964755bae38 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.732884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:06.733608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.733917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.734164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] PATH_INFO: `/v3/projects/6507f60617534696af0978be0b8ef546/users/3c3e9dcf324348a595fdd62d901b8a93/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.740926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:06.768983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2634ec-dae4-44c7-a587-8964755bae38 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.769079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6507f60617534696af0978be0b8ef546, user_id=3c3e9dcf324348a595fdd62d901b8a93, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:06.774516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533b1e1-186e-4250-aa33-d886b2f8fd63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:06.775177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b1e1-186e-4250-aa33-d886b2f8fd63 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.775603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:06.776900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b1e1-186e-4250-aa33-d886b2f8fd63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.777237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533b1e1-186e-4250-aa33-d886b2f8fd63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.792304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533b1e1-186e-4250-aa33-d886b2f8fd63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:06.794789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533b1e1-186e-4250-aa33-d886b2f8fd63 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:06.804361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 809/1613] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:06.805510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe001c-2944-4657-aa1c-a90f41874d93 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:06.806473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe001c-2944-4657-aa1c-a90f41874d93 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:06.806762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe001c-2944-4657-aa1c-a90f41874d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:06.844414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5cfe001c-2944-4657-aa1c-a90f41874d93 None None] MFA Rules not processed for user `49964c052c47422b80bd03c724052019`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:06.845726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5cfe001c-2944-4657-aa1c-a90f41874d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:06.922679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 805/1614] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:06 2022] PUT /identity/v3/projects/6507f60617534696af0978be0b8ef546/users/3c3e9dcf324348a595fdd62d901b8a93/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:06.922679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.941880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 810/1615] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:06.948122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe001c-2944-4657-aa1c-a90f41874d93 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:06.952782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe001c-2944-4657-aa1c-a90f41874d93 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:06.999869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2699f-9a4e-4e70-9d45-dbfbad4075af admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.010069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ef922-260c-40ba-875b-825a50c5cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.010753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef922-260c-40ba-875b-825a50c5cae5 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.011472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef922-260c-40ba-875b-825a50c5cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.011472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ef922-260c-40ba-875b-825a50c5cae5 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.012003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef922-260c-40ba-875b-825a50c5cae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.015826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ef922-260c-40ba-875b-825a50c5cae5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.024874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b1796-5c5d-47ff-8186-2ee862bd9882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.025770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1796-5c5d-47ff-8186-2ee862bd9882 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.026121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1796-5c5d-47ff-8186-2ee862bd9882 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.026553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b1796-5c5d-47ff-8186-2ee862bd9882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.040768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b1796-5c5d-47ff-8186-2ee862bd9882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.042512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044b1796-5c5d-47ff-8186-2ee862bd9882 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.054780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 811/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:07.056387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a43c-7d25-47d5-924a-e8b67975b5b4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.056783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a43c-7d25-47d5-924a-e8b67975b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.062998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08a43c-7d25-47d5-924a-e8b67975b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.112758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2f08a43c-7d25-47d5-924a-e8b67975b5b4 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:07.114161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2f08a43c-7d25-47d5-924a-e8b67975b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:07.122182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 806/1617] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:06 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:07.124262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a23e91-04ff-48c0-bbab-15361d975c53 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.124565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a23e91-04ff-48c0-bbab-15361d975c53 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.124894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a23e91-04ff-48c0-bbab-15361d975c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.158859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-24a23e91-04ff-48c0-bbab-15361d975c53 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:07.164973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-24a23e91-04ff-48c0-bbab-15361d975c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:07.182546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 807/1618] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:07.184291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a23e91-04ff-48c0-bbab-15361d975c53 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.195531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a23e91-04ff-48c0-bbab-15361d975c53 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.203410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:07.210196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.211700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.212278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.213049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.214318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.216918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.225177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 812/1619] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Aug 22 05:50:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:07.226132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08a43c-7d25-47d5-924a-e8b67975b5b4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.241227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08a43c-7d25-47d5-924a-e8b67975b5b4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.246259 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.246877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.247162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.247444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.248672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.250261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.264829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 813/1620] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:07.264829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.278627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fe4cf-4c69-4915-a047-c18b3d2b7f47 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.284137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.284900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.285250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.285605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.297196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.298832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.316954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 814/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:07.317941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.332166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfc1e4-cc44-4b2e-bd14-ff9b223d92e9 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.338930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.411731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.411731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.411731 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.428467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 808/1622] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:07 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:07.428467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.461233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.463246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.474080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 815/1623] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:07.479739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.485846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c333cb-695f-4be0-afaa-17f7a12990a3 service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.486046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f53d85-879b-4eb2-a35a-e515af89cdfd admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.491298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.491434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.491935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.492058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.492251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.492368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.492540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] PATH_INFO: `/v3/projects/78715a5ed5cf414c9de7c0c6208b6518/users/62e5ab446a144d5ba244c6130bac9ef0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.492651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.493288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.495467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.514397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78715a5ed5cf414c9de7c0c6208b6518, user_id=62e5ab446a144d5ba244c6130bac9ef0, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.517461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.591969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 816/1624] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:07 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:07.595851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.596023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 809/1625] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:07 2022] PUT /identity/v3/projects/78715a5ed5cf414c9de7c0c6208b6518/users/62e5ab446a144d5ba244c6130bac9ef0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:07.599970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.610019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dbae9a-60ac-48ed-8944-28d00faa72b2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.700048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:07.722247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.725773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.726428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.726787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.728867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.733064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.733286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a8649-42ba-4ccf-ae24-d9120aa13de4 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.742714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a043e76-902c-442f-981f-52fc1a7287cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.745091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a043e76-902c-442f-981f-52fc1a7287cd admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.746257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a043e76-902c-442f-981f-52fc1a7287cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.746813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a043e76-902c-442f-981f-52fc1a7287cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.747877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a043e76-902c-442f-981f-52fc1a7287cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.751605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a043e76-902c-442f-981f-52fc1a7287cd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.758855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 817/1626] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:07.761647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.771313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 810/1627] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:07.772806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f82ee-4e4a-4484-a29c-929d7aaa52ae None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.773204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f82ee-4e4a-4484-a29c-929d7aaa52ae None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.773586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f82ee-4e4a-4484-a29c-929d7aaa52ae None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.775453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 811/1628] 10.222.0.27 () {54 vars in 912 bytes} [Mon Aug 22 05:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:50:07.776452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f82ee-4e4a-4484-a29c-929d7aaa52ae None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:07.788732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80524d4-e37a-4006-b64b-0a374301016d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.790638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f82ee-4e4a-4484-a29c-929d7aaa52ae None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:07.796391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86764909-665d-42d5-a889-128781ca3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.799920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0ad0d-97e2-4a41-a789-3528653d0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:07.799920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ad0d-97e2-4a41-a789-3528653d0ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.799920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ad0d-97e2-4a41-a789-3528653d0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.799920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0ad0d-97e2-4a41-a789-3528653d0ac7 admin admin] PATH_INFO: `/v3/projects/78715a5ed5cf414c9de7c0c6208b6518/users/62e5ab446a144d5ba244c6130bac9ef0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.800353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764909-665d-42d5-a889-128781ca3bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.800353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764909-665d-42d5-a889-128781ca3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.800353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86764909-665d-42d5-a889-128781ca3bfe admin admin] PATH_INFO: `/v3/projects/e0b71064813148cd914c247df3889cd5/users/2db67d454cac4d69a15a2a699593f985/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.801511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0ad0d-97e2-4a41-a789-3528653d0ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78715a5ed5cf414c9de7c0c6208b6518, user_id=62e5ab446a144d5ba244c6130bac9ef0, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.804781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0ad0d-97e2-4a41-a789-3528653d0ac7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.832097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 812/1629] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:07 2022] PUT /identity/v3/projects/78715a5ed5cf414c9de7c0c6208b6518/users/62e5ab446a144d5ba244c6130bac9ef0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:07.832097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10218b1d-4b33-46e7-85dc-fec80218c8e0 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.832097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10218b1d-4b33-46e7-85dc-fec80218c8e0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.832097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10218b1d-4b33-46e7-85dc-fec80218c8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.839158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86764909-665d-42d5-a889-128781ca3bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b71064813148cd914c247df3889cd5, user_id=2db67d454cac4d69a15a2a699593f985, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:07.846330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86764909-665d-42d5-a889-128781ca3bfe admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:07.858016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-10218b1d-4b33-46e7-85dc-fec80218c8e0 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:07.858016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-10218b1d-4b33-46e7-85dc-fec80218c8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:07.942045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 818/1630] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:07 2022] PUT /identity/v3/projects/e0b71064813148cd914c247df3889cd5/users/2db67d454cac4d69a15a2a699593f985/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:50:07.942179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e05f-3e44-46da-a817-001b8a746068 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:07.942388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e05f-3e44-46da-a817-001b8a746068 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:07.942670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221e05f-3e44-46da-a817-001b8a746068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:07.966262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:07.984377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 813/1631] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:50:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:07.985291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10218b1d-4b33-46e7-85dc-fec80218c8e0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:08.006644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c221e05f-3e44-46da-a817-001b8a746068 None None] MFA Rules not processed for user `62e5ab446a144d5ba244c6130bac9ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:08.008522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c221e05f-3e44-46da-a817-001b8a746068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:08.098285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10218b1d-4b33-46e7-85dc-fec80218c8e0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:08.156973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 819/1632] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:08.157373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e05f-3e44-46da-a817-001b8a746068 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:08.190311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:08.221585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:08.226188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:08.226188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:08.226188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:08.226188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:08.228036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:08.228972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221e05f-3e44-46da-a817-001b8a746068 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:08.237655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2934ee14-015b-427d-8a26-62cecbf4c313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:08.238462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934ee14-015b-427d-8a26-62cecbf4c313 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:08.238753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934ee14-015b-427d-8a26-62cecbf4c313 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:08.239026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2934ee14-015b-427d-8a26-62cecbf4c313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:08.244394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 814/1633] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:08.246052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:08.269744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795e350-30ff-4f0c-81f1-c6dffae4b94b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:08.286770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:08.287735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:08.288251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:08.288739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:08.312376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:08.314069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:08.349114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934ee14-015b-427d-8a26-62cecbf4c313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:08.353684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2934ee14-015b-427d-8a26-62cecbf4c313 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:08.359566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 815/1634] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:08.360595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:08.389204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa823532-b95e-4598-a507-69da623f49ee service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:08.392243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 820/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:08.413582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:08.417079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:08.417079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:08.417079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] PATH_INFO: `/v3/projects/e0b71064813148cd914c247df3889cd5/users/2db67d454cac4d69a15a2a699593f985/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:08.417079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b71064813148cd914c247df3889cd5, user_id=2db67d454cac4d69a15a2a699593f985, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:08.419946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:08.461573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 816/1636] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:08 2022] PUT /identity/v3/projects/e0b71064813148cd914c247df3889cd5/users/2db67d454cac4d69a15a2a699593f985/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:08.463922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e192d9-dac0-4422-ad7e-b3066ad49cab None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:08.464240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e192d9-dac0-4422-ad7e-b3066ad49cab None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:08.464527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e192d9-dac0-4422-ad7e-b3066ad49cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:08.525479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-62e192d9-dac0-4422-ad7e-b3066ad49cab None None] MFA Rules not processed for user `2db67d454cac4d69a15a2a699593f985`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:08.526704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-62e192d9-dac0-4422-ad7e-b3066ad49cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:08.665753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:08.687262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 821/1637] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:08.738706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e881fbb-a49f-4874-bd98-20328780639d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:08.743998 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:08.744981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:08.746841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:08.746841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:08.865661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:08.869760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:08.888120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:08.895346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 817/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:09.735476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:09.735476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e192d9-dac0-4422-ad7e-b3066ad49cab None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:09.735476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e192d9-dac0-4422-ad7e-b3066ad49cab None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:09.735476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b29440-6a94-4a2b-a6fb-74a042dd4fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:09.738602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29440-6a94-4a2b-a6fb-74a042dd4fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:09.738602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29440-6a94-4a2b-a6fb-74a042dd4fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:09.738602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29440-6a94-4a2b-a6fb-74a042dd4fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:09.738602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29440-6a94-4a2b-a6fb-74a042dd4fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:09.738602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29440-6a94-4a2b-a6fb-74a042dd4fa3 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:09.738602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 822/1639] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:10.142435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:10.158411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22494f8-21b8-47df-a701-0d7b26b49079 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:10.168109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd5d29-bd76-47aa-ae03-65974aacab62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:10.172735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd5d29-bd76-47aa-ae03-65974aacab62 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:10.172735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd5d29-bd76-47aa-ae03-65974aacab62 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:10.172735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd5d29-bd76-47aa-ae03-65974aacab62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:10.334788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd5d29-bd76-47aa-ae03-65974aacab62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:10.336769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd5d29-bd76-47aa-ae03-65974aacab62 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:10.360383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 818/1640] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:10.818578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506c34-f5b9-4ae6-bd2d-395308cbab80 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:10.819135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506c34-f5b9-4ae6-bd2d-395308cbab80 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:10.819135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3506c34-f5b9-4ae6-bd2d-395308cbab80 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:10.820935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 823/1641] 10.222.0.27 () {54 vars in 962 bytes} [Mon Aug 22 05:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:50:10.833310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa82d-7ffd-4f53-a4de-287ccce56282 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:10.833669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa82d-7ffd-4f53-a4de-287ccce56282 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:10.834878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa82d-7ffd-4f53-a4de-287ccce56282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:10.864008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fc7aa82d-7ffd-4f53-a4de-287ccce56282 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:10.865307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fc7aa82d-7ffd-4f53-a4de-287ccce56282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:10.988245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:11.092148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 819/1642] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Aug 22 05:50:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:11.093044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45116b0-faf2-40af-afb1-ef1ca0d14e57 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:11.093337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45116b0-faf2-40af-afb1-ef1ca0d14e57 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:11.093616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45116b0-faf2-40af-afb1-ef1ca0d14e57 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:11.096168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 824/1643] 10.222.0.27 () {54 vars in 912 bytes} [Mon Aug 22 05:50:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:50:11.104428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8b88a-cac8-40f1-ab79-0396d9b91bf4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:11.104727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8b88a-cac8-40f1-ab79-0396d9b91bf4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:11.105014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8b88a-cac8-40f1-ab79-0396d9b91bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:11.156360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4ef8b88a-cac8-40f1-ab79-0396d9b91bf4 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:11.157944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4ef8b88a-cac8-40f1-ab79-0396d9b91bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:11.193123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45116b0-faf2-40af-afb1-ef1ca0d14e57 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:11.194908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 820/1644] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:50:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:11.225242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45116b0-faf2-40af-afb1-ef1ca0d14e57 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:11.243506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:11.244428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:11.244939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:11.246367 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:11.321526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:11.326993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:11.361737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 825/1645] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:13.038590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc225-c4db-492e-9034-ebf760f15720 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:13.039512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc225-c4db-492e-9034-ebf760f15720 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:13.039974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc225-c4db-492e-9034-ebf760f15720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:13.103706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-130cc225-c4db-492e-9034-ebf760f15720 None None] MFA Rules not processed for user `d7d7577ea743410ca308f62b04e7cf58`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:13.110545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-130cc225-c4db-492e-9034-ebf760f15720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:13.222845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 821/1646] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:13.234750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:13.249322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0dc22-bc2d-4bf2-9cb8-706fd9928664 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:13.257819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b2047-b136-4eaa-9059-13088b31e59a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:13.258884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b2047-b136-4eaa-9059-13088b31e59a service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:13.259317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b2047-b136-4eaa-9059-13088b31e59a service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:13.259736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b2047-b136-4eaa-9059-13088b31e59a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:13.270812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b2047-b136-4eaa-9059-13088b31e59a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:13.272428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b2047-b136-4eaa-9059-13088b31e59a service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:13.323090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 826/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:14.810928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cc225-c4db-492e-9034-ebf760f15720 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:14.908329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cc225-c4db-492e-9034-ebf760f15720 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:14.915678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:14.917139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:14.927359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:14.927359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] PATH_INFO: `/v3/users/fee118f5f48f43329138d815d951d212` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:14.927359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee118f5f48f43329138d815d951d212)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:14.927359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: WARNING py.warnings [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:50:14.927359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: warnings.warn(msg) Aug 22 05:50:14.927359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: Aug 22 05:50:14.927359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:15.298360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee118f5f48f43329138d815d951d212'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:15.299390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee118f5f48f43329138d815d951d212'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:15.300379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee118f5f48f43329138d815d951d212'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:15.334434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee118f5f48f43329138d815d951d212'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:15.508874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee118f5f48f43329138d815d951d212'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:15.525838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:15.548027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 822/1648] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:14 2022] DELETE /identity/v3/users/fee118f5f48f43329138d815d951d212 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:15.554396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:15.555480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:15.555982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:15.614492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:15.615969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:15.797188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 827/1649] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:15.811019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:15.811019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:15.989175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47162ad-5838-424e-8d92-3f8cf72f8ea3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:16.008326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca201cf2-eafb-42e1-8308-476ef5150898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:16.011601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201cf2-eafb-42e1-8308-476ef5150898 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:16.013816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201cf2-eafb-42e1-8308-476ef5150898 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:16.014448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca201cf2-eafb-42e1-8308-476ef5150898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:16.046395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201cf2-eafb-42e1-8308-476ef5150898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:16.048399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca201cf2-eafb-42e1-8308-476ef5150898 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:16.065081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 823/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:18.555888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:18.557828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:18.584611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bf26e-cd1c-4e88-9115-0a457fb59f13 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:18.599829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:18.600723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:18.604271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:18.604271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] PATH_INFO: `/v3/projects/cf898d694468485390bd3ea470cb978b` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:18.604271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf898d694468485390bd3ea470cb978b)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:18.604271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: WARNING py.warnings [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 22 05:50:18.604271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: warnings.warn(msg) Aug 22 05:50:18.604271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: Aug 22 05:50:18.605143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:18.796840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf898d694468485390bd3ea470cb978b', 'request_id': 'req-5c42e32f-764d-40b8-8f33-25175f3c1fc6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:18.830427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf898d694468485390bd3ea470cb978b', 'request_id': 'req-5c42e32f-764d-40b8-8f33-25175f3c1fc6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:18.850022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf898d694468485390bd3ea470cb978b', 'request_id': 'req-5c42e32f-764d-40b8-8f33-25175f3c1fc6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:18.962710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] The token cache is being invalidate because project cf898d694468485390bd3ea470cb978b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:18.962909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:18.963857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5c42e32f-764d-40b8-8f33-25175f3c1fc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:18.965801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 828/1651] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:18 2022] DELETE /identity/v3/projects/cf898d694468485390bd3ea470cb978b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:18.972262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d87d7-8be5-44e3-b81c-51208447ccdf None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:18.972800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d87d7-8be5-44e3-b81c-51208447ccdf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:18.972800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d87d7-8be5-44e3-b81c-51208447ccdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.021561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4d1d87d7-8be5-44e3-b81c-51208447ccdf None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:19.022750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4d1d87d7-8be5-44e3-b81c-51208447ccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:19.139567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 824/1652] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:19.141449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c561ef5-0ffc-4229-baba-74d144c62557 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:19.141920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c561ef5-0ffc-4229-baba-74d144c62557 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:19.143436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c561ef5-0ffc-4229-baba-74d144c62557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.191076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9c561ef5-0ffc-4229-baba-74d144c62557 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:19.193172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9c561ef5-0ffc-4229-baba-74d144c62557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:19.217783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 829/1653] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:19.221792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d87d7-8be5-44e3-b81c-51208447ccdf None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:19.233136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d87d7-8be5-44e3-b81c-51208447ccdf None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:19.242972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:19.243872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:19.244390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:19.245438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.246295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:19.246936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:19.250002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:19.275043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c561ef5-0ffc-4229-baba-74d144c62557 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:19.283136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 825/1654] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:19.311530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c561ef5-0ffc-4229-baba-74d144c62557 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:19.318661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:19.319541 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:19.320037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:19.320623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.321487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:19.323831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:19.345836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:19.438803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 830/1655] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:19 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:19.445844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:19.469067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8747c0-42b1-4177-bf46-6d49eb90d608 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:19.610790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:19.611549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:19.611950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:19.612355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.613811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:19.616126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:19.744361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 826/1656] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:19 2022] POST /identity/v3/users => generated 282 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:19.748514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:19.763283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7754709-91f3-4eeb-af18-3736d47e8f63 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:19.785088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:19.787387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:19.788508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:19.788805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.795370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:19.798526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:19.811560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 831/1657] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:19.815663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:19.829065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f136746-976f-410c-96e4-2f38337140ae admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:19.835546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1898f-4eb0-4d71-be9c-c3abdc08c402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:19.836177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1898f-4eb0-4d71-be9c-c3abdc08c402 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:19.836783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1898f-4eb0-4d71-be9c-c3abdc08c402 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:19.837070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1898f-4eb0-4d71-be9c-c3abdc08c402 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.837762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1898f-4eb0-4d71-be9c-c3abdc08c402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:19.841824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1898f-4eb0-4d71-be9c-c3abdc08c402 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:19.873369 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 827/1658] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:19.877390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:19.888328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd068dc8-af66-4cb0-95f6-b192611557e5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:19.904159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:19.904955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:19.905419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:19.905705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] PATH_INFO: `/v3/projects/f50d43ff4a124dcaa37a6be58c2f601a/users/6dca646e4fe94332a5d25cfb928df750/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:19.932756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50d43ff4a124dcaa37a6be58c2f601a, user_id=6dca646e4fe94332a5d25cfb928df750, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:19.937247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:20.042668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 832/1659] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:19 2022] PUT /identity/v3/projects/f50d43ff4a124dcaa37a6be58c2f601a/users/6dca646e4fe94332a5d25cfb928df750/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:50:20.053564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a2f43-0d6b-4a70-96a1-059f99546a3d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:20.054785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a2f43-0d6b-4a70-96a1-059f99546a3d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:20.055277 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a2f43-0d6b-4a70-96a1-059f99546a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:20.074993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:20.219801 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4c2a2f43-0d6b-4a70-96a1-059f99546a3d None None] MFA Rules not processed for user `6dca646e4fe94332a5d25cfb928df750`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:20.225636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4c2a2f43-0d6b-4a70-96a1-059f99546a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:20.400039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 828/1660] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:20.404821 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:20.457843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e167723-8d87-45c7-8e5b-b1f485fa6d15 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:20.459230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e167723-8d87-45c7-8e5b-b1f485fa6d15 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:20.460641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e167723-8d87-45c7-8e5b-b1f485fa6d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:20.556996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8e167723-8d87-45c7-8e5b-b1f485fa6d15 None None] MFA Rules not processed for user `190c69a502cf4f0ca8eb1de49bd86888`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:20.561090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8e167723-8d87-45c7-8e5b-b1f485fa6d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:20.665589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eb2a1-3fb2-4840-89f0-00044b4399f6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:20.686144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:20.686787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:20.687080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:20.687663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:20.688002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:20.690164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:20.779506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 829/1661] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:20.782058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:20.782355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:20.792844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:20.819242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 833/1662] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:20 2022] POST /identity/v3/projects => generated 365 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:50:20.823459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:20.874495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] MFA Rules not processed for user `190c69a502cf4f0ca8eb1de49bd86888`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:20.881849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:21.047486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023e15-a364-4c18-b88d-236ef4604455 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:21.060924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:21.061588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.061886 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.062162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.062815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:21.064896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 830/1663] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:21.066215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:21.084806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:21.086305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:21.208010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c3f6e-d5d4-49fa-b7db-efe9d4876923 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:21.212721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 834/1664] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:20 2022] POST /identity/v3/users => generated 289 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:50:21.217176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:21.232698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2189a88-9e98-44b4-8fd3-9e48b344f184 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:21.233605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:21.234264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.234772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.235196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.247959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724db147-9ce5-43d1-b34a-bc4a6197aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:21.249902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db147-9ce5-43d1-b34a-bc4a6197aed6 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.251037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db147-9ce5-43d1-b34a-bc4a6197aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.251844 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db147-9ce5-43d1-b34a-bc4a6197aed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.253986 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724db147-9ce5-43d1-b34a-bc4a6197aed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:21.254223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:21.257828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724db147-9ce5-43d1-b34a-bc4a6197aed6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:21.259979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:21.301371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 831/1665] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:50:21.309693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:21.310905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 835/1666] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:21.338368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7407f2-1360-4eea-841c-26776c6d73ce service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:21.355945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:21.357459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.357910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.358346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] PATH_INFO: `/v3/projects/6a58d175620c4fdfb3fbadcb51b30a2d/users/4b83a16221044e2d90234cf19fbea10c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.422061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a58d175620c4fdfb3fbadcb51b30a2d, user_id=4b83a16221044e2d90234cf19fbea10c, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:21.440329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:21.504946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17dfe9-25af-49cb-b374-2de079499108 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.505428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17dfe9-25af-49cb-b374-2de079499108 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.505890 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17dfe9-25af-49cb-b374-2de079499108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.536545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 832/1667] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:21 2022] PUT /identity/v3/projects/6a58d175620c4fdfb3fbadcb51b30a2d/users/4b83a16221044e2d90234cf19fbea10c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:21.542944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:21.610465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-df17dfe9-25af-49cb-b374-2de079499108 None None] MFA Rules not processed for user `d7d7577ea743410ca308f62b04e7cf58`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:21.620948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-df17dfe9-25af-49cb-b374-2de079499108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:21.670982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:21.738467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:21.767343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a58b7-7457-40f3-988e-6ead9e2360b6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:21.790612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542f59ad-908d-47d1-b4dd-46f777fcecdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:21.790612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f59ad-908d-47d1-b4dd-46f777fcecdc admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.790612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f59ad-908d-47d1-b4dd-46f777fcecdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.790965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542f59ad-908d-47d1-b4dd-46f777fcecdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.793818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f59ad-908d-47d1-b4dd-46f777fcecdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:21.796790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542f59ad-908d-47d1-b4dd-46f777fcecdc admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:21.798793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 836/1668] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:21.844895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 833/1669] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:21.848007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17dfe9-25af-49cb-b374-2de079499108 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:21.865696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df17dfe9-25af-49cb-b374-2de079499108 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:21.881114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:21.882320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.882770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.883874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] PATH_INFO: `/v3/projects/6a58d175620c4fdfb3fbadcb51b30a2d/users/4b83a16221044e2d90234cf19fbea10c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.889280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a58d175620c4fdfb3fbadcb51b30a2d, user_id=4b83a16221044e2d90234cf19fbea10c, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:21.894411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:21.920927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 837/1670] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:21 2022] PUT /identity/v3/projects/6a58d175620c4fdfb3fbadcb51b30a2d/users/4b83a16221044e2d90234cf19fbea10c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:50:21.933120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:21.933882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:21.935523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:21.948705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:21.948705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:22.045252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] MFA Rules not processed for user `4b83a16221044e2d90234cf19fbea10c`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:22.058900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:22.130324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099fe1d-8ca3-46d9-a827-139f52a559af admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:22.146439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:22.148180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:22.148738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:22.149175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] PATH_INFO: `/v3/users/49964c052c47422b80bd03c724052019` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:22.152255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49964c052c47422b80bd03c724052019)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:22.162846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:22.224855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 834/1671] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:22.237505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:22.239184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:22.325524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee21d-41eb-4395-a2df-65f450454643 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:22.333040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c828b-7ff7-4ad2-8ae1-d8df1b02e1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:22.335101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c828b-7ff7-4ad2-8ae1-d8df1b02e1ee service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:22.336828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c828b-7ff7-4ad2-8ae1-d8df1b02e1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:22.336828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c828b-7ff7-4ad2-8ae1-d8df1b02e1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:22.356576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c828b-7ff7-4ad2-8ae1-d8df1b02e1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:22.363697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c828b-7ff7-4ad2-8ae1-d8df1b02e1ee service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:22.386772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 835/1672] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:50:22.475297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49964c052c47422b80bd03c724052019'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:22.476916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49964c052c47422b80bd03c724052019'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:22.477981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49964c052c47422b80bd03c724052019'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:22.500516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49964c052c47422b80bd03c724052019'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:22.616685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-14613bd7-970e-46c5-8082-6b545e47b5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49964c052c47422b80bd03c724052019'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:22.662248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 838/1673] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:21 2022] DELETE /identity/v3/users/49964c052c47422b80bd03c724052019 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:50:22.665359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:22.665359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:22.665359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:22.687491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:22.694223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:22.694386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:22.729961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbf3d-43c1-429a-bcd9-95c92298bc13 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:22.730328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbf3d-43c1-429a-bcd9-95c92298bc13 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:22.730678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fbf3d-43c1-429a-bcd9-95c92298bc13 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:22.732772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 839/1674] 10.222.0.27 () {54 vars in 912 bytes} [Mon Aug 22 05:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:50:22.738013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:22.738386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:22.738739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:22.902849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 836/1675] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:22.910504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] MFA Rules not processed for user `2d46d5905b004073b10e694ab79e7187`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:22.913403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:22.987013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 840/1676] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:50:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 22 05:50:22.989823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:22.993383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:23.014054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc30fd-843e-43ba-9f53-0fbf2ef8dcec None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:23.029021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a3589-b3f3-4b96-ba10-b0fe9829506e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:23.029021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3589-b3f3-4b96-ba10-b0fe9829506e service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:23.029021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3589-b3f3-4b96-ba10-b0fe9829506e service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:23.029021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a3589-b3f3-4b96-ba10-b0fe9829506e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:23.033887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a3589-b3f3-4b96-ba10-b0fe9829506e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:23.035821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a3589-b3f3-4b96-ba10-b0fe9829506e service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:23.043200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:23.045239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:23.084983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eeb04-a42b-4947-8c69-2a6388ea4eb0 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:23.087586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 837/1677] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:23.101866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc578b8-c62b-42b0-9856-d47b9b105fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:23.104059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc578b8-c62b-42b0-9856-d47b9b105fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:23.104930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc578b8-c62b-42b0-9856-d47b9b105fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:23.106853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc578b8-c62b-42b0-9856-d47b9b105fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:23.127184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc578b8-c62b-42b0-9856-d47b9b105fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:23.131618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc578b8-c62b-42b0-9856-d47b9b105fe0 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:23.156296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 841/1678] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:23.395854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883f10-733a-40c7-b015-49928c721966 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:23.396439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883f10-733a-40c7-b015-49928c721966 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:23.396439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e883f10-733a-40c7-b015-49928c721966 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:23.404243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 838/1679] 10.222.0.27 () {54 vars in 912 bytes} [Mon Aug 22 05:50:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:50:23.411143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:23.411516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:23.411816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:23.448037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] MFA Rules not processed for user `2d46d5905b004073b10e694ab79e7187`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:23.450496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:23.454963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:23.466577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 842/1680] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:50:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:23.507981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883f10-733a-40c7-b015-49928c721966 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:23.527545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e883f10-733a-40c7-b015-49928c721966 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:23.534992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e2ade-59dc-4d9d-8e67-8b49798e68d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:23.535809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2ade-59dc-4d9d-8e67-8b49798e68d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:23.538496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2ade-59dc-4d9d-8e67-8b49798e68d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:23.539203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e2ade-59dc-4d9d-8e67-8b49798e68d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:23.557293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e2ade-59dc-4d9d-8e67-8b49798e68d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:23.561147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e2ade-59dc-4d9d-8e67-8b49798e68d0 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:23.579428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 839/1681] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:23.987896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:23.992660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:24.009280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cadf6-d562-4dee-8372-baa66ba31673 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:24.016302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:24.021213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:24.021213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:24.021213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] PATH_INFO: `/v3/users/6dca646e4fe94332a5d25cfb928df750` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:24.021213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dca646e4fe94332a5d25cfb928df750)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:24.022478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:24.261619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dca646e4fe94332a5d25cfb928df750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:24.266113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dca646e4fe94332a5d25cfb928df750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:24.266113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dca646e4fe94332a5d25cfb928df750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:24.289161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dca646e4fe94332a5d25cfb928df750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:24.370834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ba2732d7-8172-45f4-b4fc-6cfa0dc26131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dca646e4fe94332a5d25cfb928df750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:24.446480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 843/1682] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:23 2022] DELETE /identity/v3/users/6dca646e4fe94332a5d25cfb928df750 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:24.447649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:24.448097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:24.448350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:24.502068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb2c5-36cf-4900-bd9e-c6269b51cbe8 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:24.502777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb2c5-36cf-4900-bd9e-c6269b51cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:24.503253 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4eb2c5-36cf-4900-bd9e-c6269b51cbe8 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:24.505432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 844/1683] 10.222.0.27 () {54 vars in 961 bytes} [Mon Aug 22 05:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:50:24.509528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:24.510770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:24.511244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:24.511714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:24.512172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:24.595596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:24.597927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:24.764303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 840/1684] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:24.796799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:24.798405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:24.846788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 845/1685] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Aug 22 05:50:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:50:24.848363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:24.851640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:24.916426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:24.995250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887bfde-59d2-4a93-bd97-523a1a1e8c79 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:25.009830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:25.011776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:25.012085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:25.014923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:25.024445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b84ed-1cdc-48cd-8405-8c969d771bcf None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:25.033722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:25.034367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:25.034656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:25.035101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:25.044141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:25.047813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:25.048284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:25.069962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 846/1686] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:25.070876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:25.098172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21e3d7-470a-49f5-b9fa-d476ae1cd163 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:25.112613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:25.114621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:25.114909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:25.116223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:25.117938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:25.122169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:25.139151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 841/1687] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:25.152412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:25.155907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:25.198848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 847/1688] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:25.800011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:25.874803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:25.876576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:25.911489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723e084-5a58-4d41-89c2-5612d9970bea service placement] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:25.925598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:25.926243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:25.926906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:25.927677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] PATH_INFO: `/v3/projects/a457b7ad8fab4b62a2a173c9e9e1d1d9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:25.931309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a457b7ad8fab4b62a2a173c9e9e1d1d9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:25.937474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:26.270109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a457b7ad8fab4b62a2a173c9e9e1d1d9', 'request_id': 'req-2eaca2fe-cf60-4160-af8c-7d000e93c214'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:26.288731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a457b7ad8fab4b62a2a173c9e9e1d1d9', 'request_id': 'req-2eaca2fe-cf60-4160-af8c-7d000e93c214'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:26.396634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a457b7ad8fab4b62a2a173c9e9e1d1d9', 'request_id': 'req-2eaca2fe-cf60-4160-af8c-7d000e93c214'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:26.427029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] The token cache is being invalidate because project a457b7ad8fab4b62a2a173c9e9e1d1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:26.427341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:26.430683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:26.439319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 842/1689] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:25 2022] DELETE /identity/v3/projects/a457b7ad8fab4b62a2a173c9e9e1d1d9 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:26.445879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:26.468676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2fdb9d-de7f-4d38-ac67-90a60572388e service placement] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:26.753304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:26.753988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:26.754265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:26.757739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] PATH_INFO: `/v3/users/2db67d454cac4d69a15a2a699593f985` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:26.760239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db67d454cac4d69a15a2a699593f985)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:26.769814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:26.809437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:26.811314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:26.854851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaca2fe-cf60-4160-af8c-7d000e93c214 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:26.877449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:26.878471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:26.878783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:26.885846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] PATH_INFO: `/v3/projects/f50d43ff4a124dcaa37a6be58c2f601a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:26.891167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50d43ff4a124dcaa37a6be58c2f601a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:26.893689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:27.103183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db67d454cac4d69a15a2a699593f985'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.103885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db67d454cac4d69a15a2a699593f985'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.108563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db67d454cac4d69a15a2a699593f985'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.141192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db67d454cac4d69a15a2a699593f985'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.169112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50d43ff4a124dcaa37a6be58c2f601a', 'request_id': 'req-0c2008f3-dd2d-4ee5-8743-858e0193843f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.197077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50d43ff4a124dcaa37a6be58c2f601a', 'request_id': 'req-0c2008f3-dd2d-4ee5-8743-858e0193843f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.201694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ea50272f-9d75-4bf2-9276-71062b0f8657 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db67d454cac4d69a15a2a699593f985'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.241597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 848/1690] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:26 2022] DELETE /identity/v3/users/2db67d454cac4d69a15a2a699593f985 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:27.246168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:27.246964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:27.247351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:27.287720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50d43ff4a124dcaa37a6be58c2f601a', 'request_id': 'req-0c2008f3-dd2d-4ee5-8743-858e0193843f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.313258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] The token cache is being invalidate because project f50d43ff4a124dcaa37a6be58c2f601a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:27.314817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.317978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:27.322685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 843/1691] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:26 2022] DELETE /identity/v3/projects/f50d43ff4a124dcaa37a6be58c2f601a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:27.329947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:27.333000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:27.349400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] MFA Rules not processed for user `3c3e9dcf324348a595fdd62d901b8a93`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:27.351147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:27.451113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:27.537758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 849/1692] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:27.557881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:27.561275 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:27.598652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2008f3-dd2d-4ee5-8743-858e0193843f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:27.752651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:27.756359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:27.762201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:27.763908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] PATH_INFO: `/v3/users/4b83a16221044e2d90234cf19fbea10c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:27.767208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b83a16221044e2d90234cf19fbea10c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:27.772595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:27.789120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f83bd4-7294-4994-8c94-afd90d510370 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:27.819492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a38d8b-2692-43d0-aee7-9c3c46e67497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:27.820140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a38d8b-2692-43d0-aee7-9c3c46e67497 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:27.824345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a38d8b-2692-43d0-aee7-9c3c46e67497 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:27.824345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a38d8b-2692-43d0-aee7-9c3c46e67497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:27.859069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a38d8b-2692-43d0-aee7-9c3c46e67497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:27.865021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a38d8b-2692-43d0-aee7-9c3c46e67497 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:27.897059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 850/1693] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:27.898516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915247e-f204-46f4-8210-e854fd44f57f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:27.898876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915247e-f204-46f4-8210-e854fd44f57f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:27.901696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915247e-f204-46f4-8210-e854fd44f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:28.002283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e915247e-f204-46f4-8210-e854fd44f57f None None] MFA Rules not processed for user `cae765348a434c4e8cdf46690bb5a167`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:28.006966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e915247e-f204-46f4-8210-e854fd44f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:28.155829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b83a16221044e2d90234cf19fbea10c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:28.156769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b83a16221044e2d90234cf19fbea10c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:28.159397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b83a16221044e2d90234cf19fbea10c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:28.223747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b83a16221044e2d90234cf19fbea10c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:28.242410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:28.255512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 851/1694] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:28.266338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:28.266628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:28.268374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:28.299724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b81c1572-a346-473b-865a-9eb2b62da64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b83a16221044e2d90234cf19fbea10c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:28.338699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 844/1695] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:27 2022] DELETE /identity/v3/users/4b83a16221044e2d90234cf19fbea10c => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:28.371339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] MFA Rules not processed for user `cae765348a434c4e8cdf46690bb5a167`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:28.373861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:28.471946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:28.473073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:28.473443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:28.570004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 852/1696] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:28.573086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] MFA Rules not processed for user `a844362c07764ff9b43719573f6cdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:28.576542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:28.660668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:28.662672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:28.760724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 845/1697] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:28.833733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:28.837767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:28.976372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e7943-0de6-4baf-99bd-5cd4adfa2333 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:28.994942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:29.000433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:29.000827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:29.001154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:29.018729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b0c9d-3778-4cfe-848f-47d83c3ba56b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:29.021253 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:29.023729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:29.041975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:29.042568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:29.042846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:29.043125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:29.065085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 853/1698] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:29.066270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:29.069499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:29.084994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:29.089921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:29.133339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 846/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:29.338255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f7bee-d1a4-432d-aa71-7bfe4543b88c service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:29.348408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:29.349320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:29.349817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:29.350929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] PATH_INFO: `/v3/projects/e0b71064813148cd914c247df3889cd5` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:29.353153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b71064813148cd914c247df3889cd5)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:29.370790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:29.580217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b71064813148cd914c247df3889cd5', 'request_id': 'req-f9d67f06-8a68-49f9-a8cb-5dc425213a05'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:29.594195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b71064813148cd914c247df3889cd5', 'request_id': 'req-f9d67f06-8a68-49f9-a8cb-5dc425213a05'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:29.600530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b71064813148cd914c247df3889cd5', 'request_id': 'req-f9d67f06-8a68-49f9-a8cb-5dc425213a05'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:29.665961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:29.669331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:29.686255 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2b254-9728-4868-ac62-62fc35714344 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:29.702283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] The token cache is being invalidate because project e0b71064813148cd914c247df3889cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:29.702660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:29.703551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f9d67f06-8a68-49f9-a8cb-5dc425213a05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:29.706728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 854/1700] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:29 2022] DELETE /identity/v3/projects/e0b71064813148cd914c247df3889cd5 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:29.711929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730964-5998-47f3-b9f9-d7d766844e13 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:29.712252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730964-5998-47f3-b9f9-d7d766844e13 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:29.713207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7730964-5998-47f3-b9f9-d7d766844e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:29.758426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c7730964-5998-47f3-b9f9-d7d766844e13 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:29.760991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c7730964-5998-47f3-b9f9-d7d766844e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:29.819496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:29.859105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:29.859344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:29.859544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:29.862075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] PATH_INFO: `/v3/projects/6a58d175620c4fdfb3fbadcb51b30a2d` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:29.864423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a58d175620c4fdfb3fbadcb51b30a2d)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:29.868734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:29.943732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 855/1701] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:29.957379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3846a-105f-4560-9870-31466a3791b2 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:29.957858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3846a-105f-4560-9870-31466a3791b2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:29.958439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3846a-105f-4560-9870-31466a3791b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.015225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b6d3846a-105f-4560-9870-31466a3791b2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:30.020948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b6d3846a-105f-4560-9870-31466a3791b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:30.042067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 856/1702] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:30.046491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3846a-105f-4560-9870-31466a3791b2 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:30.075332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3846a-105f-4560-9870-31466a3791b2 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:30.080711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a58d175620c4fdfb3fbadcb51b30a2d', 'request_id': 'req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:30.101697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a58d175620c4fdfb3fbadcb51b30a2d', 'request_id': 'req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:30.205613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a58d175620c4fdfb3fbadcb51b30a2d', 'request_id': 'req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:30.211282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:30.241438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:30.242643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.243173 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.243738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.244565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] The token cache is being invalidate because project 6a58d175620c4fdfb3fbadcb51b30a2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:30.245271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:30.245505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:30.247131 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3e0ce6c3-7f30-460d-8b76-1112d2519bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:30.247300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:30.249431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:30.256077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 847/1703] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:29 2022] DELETE /identity/v3/projects/6a58d175620c4fdfb3fbadcb51b30a2d => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:30.264306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297622-99a5-4064-a603-6e7722cf396e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.264861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297622-99a5-4064-a603-6e7722cf396e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.265494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6297622-99a5-4064-a603-6e7722cf396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.271706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 857/1704] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:30.282672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:30.287839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:30.302188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e6297622-99a5-4064-a603-6e7722cf396e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:30.303218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e6297622-99a5-4064-a603-6e7722cf396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:30.308603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8948a-e10c-4f86-8f6d-ef7aeae1031c admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:30.318724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e73f-4266-44b3-9814-c93de06c0e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:30.319341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e73f-4266-44b3-9814-c93de06c0e36 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.319762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e73f-4266-44b3-9814-c93de06c0e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.320045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e73f-4266-44b3-9814-c93de06c0e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.320922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e73f-4266-44b3-9814-c93de06c0e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:30.321796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 848/1705] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:30.332757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309900f-7164-4468-a075-4d1c10ff318d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.332757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309900f-7164-4468-a075-4d1c10ff318d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.332757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309900f-7164-4468-a075-4d1c10ff318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.336013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e73f-4266-44b3-9814-c93de06c0e36 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:30.396501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-3309900f-7164-4468-a075-4d1c10ff318d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:30.404365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3309900f-7164-4468-a075-4d1c10ff318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:30.430013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 849/1706] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:30.459403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309900f-7164-4468-a075-4d1c10ff318d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:30.475908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309900f-7164-4468-a075-4d1c10ff318d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:30.483369 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:30.484304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.485000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.485627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.486457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:30.487048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:30.490059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:30.506946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 850/1707] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:50:30.522577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:30.559960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca74d6-37d8-472a-aec0-f912526a93a3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:30.576293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:30.577048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.577524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.577906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.579030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:30.582127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 858/1708] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:30 2022] POST /identity/v3/projects => generated 369 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:50:30.590592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:30.590981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb89c-6d1b-4084-9de4-60c413a61d39 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.590981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb89c-6d1b-4084-9de4-60c413a61d39 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.590981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7bb89c-6d1b-4084-9de4-60c413a61d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.657091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ab7bb89c-6d1b-4084-9de4-60c413a61d39 None None] MFA Rules not processed for user `cae765348a434c4e8cdf46690bb5a167`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:30.658743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ab7bb89c-6d1b-4084-9de4-60c413a61d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:30.707538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 851/1709] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:30 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:30.714105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:30.759878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 859/1710] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:30.761136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bb89c-6d1b-4084-9de4-60c413a61d39 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:30.892929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cd73c-675a-43d1-8104-3c01b27a6b9b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:30.905917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:30.906788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:30.907194 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:30.908751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:30.909555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:30.915248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:30.940549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:31.035557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 852/1711] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:30 2022] POST /identity/v3/users => generated 285 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:31.038688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:31.051004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7bb89c-6d1b-4084-9de4-60c413a61d39 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.058664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8cb8e9-c9c3-44bb-b873-13137a9d9476 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.065558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.073622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.073622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.073622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.073622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.073622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:31.074078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.074349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.074641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.075038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.075719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.077459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:31.115490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 853/1712] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:31.116707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:31.134591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cedb5-95ad-43ad-ae9a-1acc4c8c6dfa admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.145591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.147861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.148625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.149073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.150111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.152437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:31.170674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 854/1713] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:31.171848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:31.183526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7f46c-926d-4b1e-a57d-8d6b740dc1ef admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.190483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 860/1714] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:30 2022] POST /identity/v3/users => generated 294 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:31.191798 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:31.192923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ae47e-a24b-4c00-ab5a-2a415f74d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.193880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae47e-a24b-4c00-ab5a-2a415f74d555 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.194461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae47e-a24b-4c00-ab5a-2a415f74d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.194969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ae47e-a24b-4c00-ab5a-2a415f74d555 admin admin] PATH_INFO: `/v3/projects/39f505517a8c467180df305076144b85/users/9614b94b8ebe4cf59c216d5920743858/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.211352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41bb5d6-31ca-43c5-b2eb-3555e8fb37c0 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.229285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.232120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.232303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ae47e-a24b-4c00-ab5a-2a415f74d555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f505517a8c467180df305076144b85, user_id=9614b94b8ebe4cf59c216d5920743858, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.232443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.232730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.233395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.235726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ae47e-a24b-4c00-ab5a-2a415f74d555 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:31.236332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:31.281931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 861/1715] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:50:31.300780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:31.320577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 855/1716] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:31 2022] PUT /identity/v3/projects/39f505517a8c467180df305076144b85/users/9614b94b8ebe4cf59c216d5920743858/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:31.338000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173ce98-14bd-4500-8f73-79a6407b7f6c None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.338406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173ce98-14bd-4500-8f73-79a6407b7f6c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.338787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173ce98-14bd-4500-8f73-79a6407b7f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.352732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc500a-f6c4-49b5-acf4-b65cc6ca8ccf admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.409314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-7173ce98-14bd-4500-8f73-79a6407b7f6c None None] MFA Rules not processed for user `9614b94b8ebe4cf59c216d5920743858`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:31.411048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7173ce98-14bd-4500-8f73-79a6407b7f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:31.502046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a8b53-73d4-4279-8720-b5d49d2a2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.504177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8b53-73d4-4279-8720-b5d49d2a2e8f admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.507273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8b53-73d4-4279-8720-b5d49d2a2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.507685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a8b53-73d4-4279-8720-b5d49d2a2e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.508525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8b53-73d4-4279-8720-b5d49d2a2e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.513519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a8b53-73d4-4279-8720-b5d49d2a2e8f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:31.530369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 862/1717] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:31 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:31.530369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c27b-e298-4825-ac8f-789dd91f906d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.530369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c27b-e298-4825-ac8f-789dd91f906d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.530369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c27b-e298-4825-ac8f-789dd91f906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.532989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 856/1718] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:50:31.537922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173ce98-14bd-4500-8f73-79a6407b7f6c None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:31.559375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173ce98-14bd-4500-8f73-79a6407b7f6c None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.572278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.573285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.573733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.574881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] PATH_INFO: `/v3/projects/39b4b98468f94d21a0869458dfd402e8/users/d23d7f9f0d3d4fcfa96bf3d4195c4a4b/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.602289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:31.607666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b4b98468f94d21a0869458dfd402e8, user_id=d23d7f9f0d3d4fcfa96bf3d4195c4a4b, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.610682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:31.630197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6042c27b-e298-4825-ac8f-789dd91f906d None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:31.630197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6042c27b-e298-4825-ac8f-789dd91f906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:31.708444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 857/1719] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:31 2022] PUT /identity/v3/projects/39b4b98468f94d21a0869458dfd402e8/users/d23d7f9f0d3d4fcfa96bf3d4195c4a4b/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:31.709343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:31.745524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 863/1720] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:50:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:31.750006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f93641-9d4f-4907-a113-d17bded8803e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.751538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f93641-9d4f-4907-a113-d17bded8803e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.752681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f93641-9d4f-4907-a113-d17bded8803e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.826838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f8134-7eb6-4e8d-b29b-78126fec6b70 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:31.827899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d2f93641-9d4f-4907-a113-d17bded8803e None None] MFA Rules not processed for user `d23d7f9f0d3d4fcfa96bf3d4195c4a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:31.828804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d2f93641-9d4f-4907-a113-d17bded8803e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:31.841910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:31.851102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:31.851102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:31.851102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:31.851102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:31.854073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.012510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 864/1721] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:32.016331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f93641-9d4f-4907-a113-d17bded8803e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.034064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f93641-9d4f-4907-a113-d17bded8803e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:32.040832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:32.041458 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:32.042276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:32.042564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:32.044090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:32.047241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.056159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 858/1722] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:31 2022] POST /identity/v3/projects => generated 369 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:32.072514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.163469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 865/1723] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:32 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:32.164335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.175522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441acc-589a-4eb1-9b38-39810e896401 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:32.227792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:32.272592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:32.273418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:32.273800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:32.274199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:32.274315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755febb-eeb4-4177-a4fe-6a92814485b7 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:32.274954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:32.277582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.281987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:32.281987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:32.281987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:32.281987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:32.282334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:32.283616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.411559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 866/1724] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:32 2022] POST /identity/v3/users => generated 300 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:32.412574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.414429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:32.442053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 859/1725] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:32 2022] POST /identity/v3/users => generated 291 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:32.443442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.469633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877c46bf-5f70-44b3-997d-d2a4cae933f4 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:32.478302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:32.479020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:32.479408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:32.479958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:32.481324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:32.483651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.496543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 860/1726] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:32.500142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.515640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12734982-2f68-4239-9df2-201e60c01182 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:32.531477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:32.532276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:32.532659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:32.533038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:32.533907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:32.535795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.553653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 861/1727] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:32.554855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.567205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7757c-3257-4fc1-8f05-3ec282b7359e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:32.580411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:32.590666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:32.590666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:32.590666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] PATH_INFO: `/v3/projects/9da2b3060de64b659e64671ab3f2a445/users/118df902be024862978be674b6b1455b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:32.613811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da2b3060de64b659e64671ab3f2a445, user_id=118df902be024862978be674b6b1455b, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:32.619871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.638941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c74fb-87f3-428c-a224-3e9a8fe4745a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:32.644750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:32.645377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:32.645659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:32.645940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:32.754704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 862/1728] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:32 2022] PUT /identity/v3/projects/9da2b3060de64b659e64671ab3f2a445/users/118df902be024862978be674b6b1455b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:32.756524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.759752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:32.762637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:32.779513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 867/1729] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:50:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:50:32.781479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:32.784094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:32.814692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1d90-6938-43ed-8d4f-0cb8b41d73e3 service swift] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:33.054009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365312b-6ff5-4329-acd3-c7e83626d34d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:33.075268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:33.076283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:33.076661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:33.076943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] PATH_INFO: `/v3/projects/8797d66ad7ae4f2a8b1398bc02f5a5b2/users/0d1a833a67724fc6bdb2db11f6596f9c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:33.109206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:33.109820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:33.110108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:33.110392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] PATH_INFO: `/v3/users/46c1aed4791740dea2fc1369a9c77b9a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:33.111715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c1aed4791740dea2fc1369a9c77b9a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:33.113754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:33.114696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8797d66ad7ae4f2a8b1398bc02f5a5b2, user_id=0d1a833a67724fc6bdb2db11f6596f9c, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:33.123962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:33.278523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 863/1730] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:32 2022] PUT /identity/v3/projects/8797d66ad7ae4f2a8b1398bc02f5a5b2/users/0d1a833a67724fc6bdb2db11f6596f9c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:33.279706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:33.451137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd6f5a-c692-42b5-b39d-c92a21d256a7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:33.461583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:33.462637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:33.467154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:33.468577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:33.469577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:33.472133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:33.475577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c1aed4791740dea2fc1369a9c77b9a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:33.481316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c1aed4791740dea2fc1369a9c77b9a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:33.488514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c1aed4791740dea2fc1369a9c77b9a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:33.495891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 864/1731] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:33.498001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:33.501924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:33.521177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01325-0761-4475-ad3b-744334704a34 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:33.529681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:33.530999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:33.531716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:33.532160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:33.533425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:33.536396 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:33.539842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c1aed4791740dea2fc1369a9c77b9a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:33.553540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 865/1732] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:33.554845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:33.557252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:33.591481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fe327-444b-4347-ad07-281bd0ef32ab admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:33.600667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:33.602151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:33.602151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:33.602495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] PATH_INFO: `/v3/projects/9da2b3060de64b659e64671ab3f2a445/users/118df902be024862978be674b6b1455b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:33.609415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da2b3060de64b659e64671ab3f2a445, user_id=118df902be024862978be674b6b1455b, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:33.618916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:33.652708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 866/1733] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:33 2022] PUT /identity/v3/projects/9da2b3060de64b659e64671ab3f2a445/users/118df902be024862978be674b6b1455b/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:33.653966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:33.664728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-dbf7236d-8a08-49cd-a82f-716de88a14ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c1aed4791740dea2fc1369a9c77b9a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:33.708012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:33.724859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 868/1734] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:32 2022] DELETE /identity/v3/users/46c1aed4791740dea2fc1369a9c77b9a => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:33.732323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa8ce-9822-4d41-90cb-89968644e937 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:33.732624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa8ce-9822-4d41-90cb-89968644e937 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:33.732911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9aa8ce-9822-4d41-90cb-89968644e937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:33.824396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9e9aa8ce-9822-4d41-90cb-89968644e937 None None] MFA Rules not processed for user `2d46d5905b004073b10e694ab79e7187`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:33.825655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9e9aa8ce-9822-4d41-90cb-89968644e937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:33.977393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d3b50-88f7-45f6-8e7a-9e01f5c30ce7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:34.039320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 869/1735] 10.222.0.17 () {58 vars in 1015 bytes} [Mon Aug 22 05:50:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:34.041523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.043475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.043475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.103987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:34.172953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578e321-1bdd-445e-a14d-0a7e75f59876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:34.175127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e321-1bdd-445e-a14d-0a7e75f59876 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.177097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] MFA Rules not processed for user `118df902be024862978be674b6b1455b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:34.179507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e321-1bdd-445e-a14d-0a7e75f59876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.179735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:34.180037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e321-1bdd-445e-a14d-0a7e75f59876 admin admin] PATH_INFO: `/v3/projects/8797d66ad7ae4f2a8b1398bc02f5a5b2/users/0d1a833a67724fc6bdb2db11f6596f9c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.185690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578e321-1bdd-445e-a14d-0a7e75f59876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8797d66ad7ae4f2a8b1398bc02f5a5b2, user_id=0d1a833a67724fc6bdb2db11f6596f9c, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:34.198844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578e321-1bdd-445e-a14d-0a7e75f59876 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:34.425668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 867/1736] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:33 2022] PUT /identity/v3/projects/8797d66ad7ae4f2a8b1398bc02f5a5b2/users/0d1a833a67724fc6bdb2db11f6596f9c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:34.425668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a0e2-c024-4827-8751-c6a542c27ca4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.425668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a0e2-c024-4827-8751-c6a542c27ca4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.425668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39a0e2-c024-4827-8751-c6a542c27ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.425668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-6b39a0e2-c024-4827-8751-c6a542c27ca4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:34.428949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6b39a0e2-c024-4827-8751-c6a542c27ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:34.429555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 870/1737] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:34.429555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:34.429555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:34.429555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e181ee-2caa-4703-8fde-32efe4006e36 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:34.430055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 868/1738] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:34.430055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.430055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.451194 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.482880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:34.482880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.482880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.482880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.498093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:34.500059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:34.515614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 871/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:34.527115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:34.543224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:34.573043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] MFA Rules not processed for user `0d1a833a67724fc6bdb2db11f6596f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:34.574887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:34.660095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c195-7fe8-48ed-a8c1-ee7a1bf662a3 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:34.668915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:34.671725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.671725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.671725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.802787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 869/1740] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:34.806622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:34.817798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:34.852471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6893b1d-20ce-4bf7-94c0-894368e0b323 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:34.861505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:34.864849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:34.865363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:34.868725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.869135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.869525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.896471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 872/1741] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:34.896471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:34.906628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9564bf-59aa-4980-9185-5664c3d85309 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:34.910767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:34.912095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:34.912502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:34.912913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:34.930955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:34.933131 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:34.939273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:34.941273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:34.951659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 870/1742] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:34.952744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 873/1743] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:34.954270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:34.955776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:34.978031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1336ed7-48d0-478a-8914-9b1159154187 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:35.036886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:35.044502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:35.044869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:35.045204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:35.076568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:35.092540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:35.097268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:35.100080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b195ecc-e645-4e8e-88c6-113b91a0d699 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:35.123162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:35.123774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:35.124061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:35.124542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 871/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:35.124741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] PATH_INFO: `/v3/users/d23d7f9f0d3d4fcfa96bf3d4195c4a4b` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:35.126395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23d7f9f0d3d4fcfa96bf3d4195c4a4b)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:35.132273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:35.195841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:35.397692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:35.411870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c8d2f-7c95-4037-baef-9a7b45a1b0ef service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:35.425930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b882a-c444-418a-9e0d-c39c7f860335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:35.429400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b882a-c444-418a-9e0d-c39c7f860335 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:35.429882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b882a-c444-418a-9e0d-c39c7f860335 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:35.430723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b882a-c444-418a-9e0d-c39c7f860335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:35.438307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-304b882a-c444-418a-9e0d-c39c7f860335 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:35.599114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b882a-c444-418a-9e0d-c39c7f860335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:35.600640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b882a-c444-418a-9e0d-c39c7f860335 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:35.622155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 872/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:35.783652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23d7f9f0d3d4fcfa96bf3d4195c4a4b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:35.784955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23d7f9f0d3d4fcfa96bf3d4195c4a4b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:35.789738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23d7f9f0d3d4fcfa96bf3d4195c4a4b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:35.796267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:35.818898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23d7f9f0d3d4fcfa96bf3d4195c4a4b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:35.993247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23d7f9f0d3d4fcfa96bf3d4195c4a4b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:36.046995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 874/1746] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:35 2022] DELETE /identity/v3/users/d23d7f9f0d3d4fcfa96bf3d4195c4a4b => generated 0 bytes in 968 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:36.049227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756883f-d043-4208-957a-ff4b762f2fb1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:36.049996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756883f-d043-4208-957a-ff4b762f2fb1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:36.051043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756883f-d043-4208-957a-ff4b762f2fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:36.093358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8756883f-d043-4208-957a-ff4b762f2fb1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:36.098113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8756883f-d043-4208-957a-ff4b762f2fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:36.280708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 873/1747] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:50:36.412308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:36.424272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:36.573746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82e7ac-9183-4f35-b03c-80d9859e0a6b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:36.586827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:36.587753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:36.589478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:36.590597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:36.597407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160497d-7b1f-40a7-bb10-ed35b5cc4d68 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:36.598018 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160497d-7b1f-40a7-bb10-ed35b5cc4d68 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:36.598767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160497d-7b1f-40a7-bb10-ed35b5cc4d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:36.631878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:36.635323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:36.642225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1160497d-7b1f-40a7-bb10-ed35b5cc4d68 None None] MFA Rules not processed for user `3c3e9dcf324348a595fdd62d901b8a93`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:36.645847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1160497d-7b1f-40a7-bb10-ed35b5cc4d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:36.676602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 875/1748] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:36.783019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 874/1749] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:50:37.057955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:37.310757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:38.086952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:38.088960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:38.139807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb06422-978e-4b6c-92da-fafdc1db7b59 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:38.176234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:38.176996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:38.177349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:38.177641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] PATH_INFO: `/v3/projects/d96a2fd3e8444a29af3ef0ceb38f3f9e` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:38.183982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96a2fd3e8444a29af3ef0ceb38f3f9e)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:38.186146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:38.431927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96a2fd3e8444a29af3ef0ceb38f3f9e', 'request_id': 'req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:38.451204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96a2fd3e8444a29af3ef0ceb38f3f9e', 'request_id': 'req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:38.484543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96a2fd3e8444a29af3ef0ceb38f3f9e', 'request_id': 'req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:38.608934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] The token cache is being invalidate because project d96a2fd3e8444a29af3ef0ceb38f3f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:38.609414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:38.610643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ac831e2-0b7d-4e44-9b09-8d480b5fa4fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:38.622895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 876/1750] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:38 2022] DELETE /identity/v3/projects/d96a2fd3e8444a29af3ef0ceb38f3f9e => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:38.628358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160497d-7b1f-40a7-bb10-ed35b5cc4d68 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:38.654306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160497d-7b1f-40a7-bb10-ed35b5cc4d68 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:38.819085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:38.819896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:38.820238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:38.820632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] PATH_INFO: `/v3/users/62e5ab446a144d5ba244c6130bac9ef0` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:38.821847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e5ab446a144d5ba244c6130bac9ef0)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:38.823748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:39.257791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b81a8-3dd0-4706-92ea-16dd34f1206d None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:39.260859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b81a8-3dd0-4706-92ea-16dd34f1206d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:39.262525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b81a8-3dd0-4706-92ea-16dd34f1206d None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:39.267257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 877/1751] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:50:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:50:39.333392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b81a8-3dd0-4706-92ea-16dd34f1206d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:39.341409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-bd6b81a8-3dd0-4706-92ea-16dd34f1206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:39.370519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e5ab446a144d5ba244c6130bac9ef0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.376399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e5ab446a144d5ba244c6130bac9ef0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.376399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e5ab446a144d5ba244c6130bac9ef0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.411848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e5ab446a144d5ba244c6130bac9ef0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.445938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b81a8-3dd0-4706-92ea-16dd34f1206d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:39.456236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:39.457174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:39.457608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:39.458149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] PATH_INFO: `/v3/projects/39b4b98468f94d21a0869458dfd402e8` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:39.461862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b4b98468f94d21a0869458dfd402e8)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:39.464092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:39.760936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c121bc3c-1e51-41b7-b8f9-238359d25e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e5ab446a144d5ba244c6130bac9ef0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.816175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 875/1752] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:38 2022] DELETE /identity/v3/users/62e5ab446a144d5ba244c6130bac9ef0 => generated 0 bytes in 1188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:39.816175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6ba8-7823-49e5-9dfc-90da51868606 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:39.816175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6ba8-7823-49e5-9dfc-90da51868606 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:39.816175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a6ba8-7823-49e5-9dfc-90da51868606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:39.855946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:39.858166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b4b98468f94d21a0869458dfd402e8', 'request_id': 'req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.873218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b4b98468f94d21a0869458dfd402e8', 'request_id': 'req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.882504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b4b98468f94d21a0869458dfd402e8', 'request_id': 'req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:39.883358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d25a6ba8-7823-49e5-9dfc-90da51868606 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:39.884640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d25a6ba8-7823-49e5-9dfc-90da51868606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:40.028546 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] The token cache is being invalidate because project 39b4b98468f94d21a0869458dfd402e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:40.029932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:40.030761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fcb306d4-e40d-4eff-a74c-d2397f1d87dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:40.039718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 878/1753] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:39 2022] DELETE /identity/v3/projects/39b4b98468f94d21a0869458dfd402e8 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:50:40.040218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7ad5-e726-4807-807d-d41a840c2c0d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:40.043395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7ad5-e726-4807-807d-d41a840c2c0d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:40.043704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c7ad5-e726-4807-807d-d41a840c2c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:40.094146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 876/1754] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:50:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:40.095429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a12c6e-6a2e-42fe-9d0f-aa94013018f4 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:40.096508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a12c6e-6a2e-42fe-9d0f-aa94013018f4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:40.096508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a12c6e-6a2e-42fe-9d0f-aa94013018f4 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:40.100834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 877/1755] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:50:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:50:40.141862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e06c7ad5-e726-4807-807d-d41a840c2c0d None None] MFA Rules not processed for user `a844362c07764ff9b43719573f6cdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:40.143854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e06c7ad5-e726-4807-807d-d41a840c2c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:40.173309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a12c6e-6a2e-42fe-9d0f-aa94013018f4 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:40.175638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a7a12c6e-6a2e-42fe-9d0f-aa94013018f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:40.296992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 879/1756] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:40.314378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df199e-3b4a-4242-b415-673cb05166db None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:40.314378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df199e-3b4a-4242-b415-673cb05166db None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:40.314378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df199e-3b4a-4242-b415-673cb05166db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:40.328818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-65df199e-3b4a-4242-b415-673cb05166db None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:40.330544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-65df199e-3b4a-4242-b415-673cb05166db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:40.343915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 880/1757] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:50:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:40.405082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a12c6e-6a2e-42fe-9d0f-aa94013018f4 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:40.416093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:40.416713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:40.416876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:40.417227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] PATH_INFO: `/v3/users/118df902be024862978be674b6b1455b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:40.419383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118df902be024862978be674b6b1455b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:40.421592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:40.682796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118df902be024862978be674b6b1455b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:40.684101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118df902be024862978be674b6b1455b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:40.684750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118df902be024862978be674b6b1455b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:40.703221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118df902be024862978be674b6b1455b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:40.880151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df199e-3b4a-4242-b415-673cb05166db None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:40.880151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-65df199e-3b4a-4242-b415-673cb05166db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:40.880151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df199e-3b4a-4242-b415-673cb05166db None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:40.883989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:40.883989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:40.883989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:40.883989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:40.892558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:40.892558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:40.892558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:40.892558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 881/1758] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:50:41.007994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118df902be024862978be674b6b1455b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:41.038111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 878/1759] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:40 2022] DELETE /identity/v3/users/118df902be024862978be674b6b1455b => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:41.309137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:41.587187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:41.590956 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:41.664971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eee0b3-a911-4a04-abf6-45b167c89281 service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:41.813478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:41.814760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:41.815275 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:41.816514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:41.819347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:41.864370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:41.891355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:41.927717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 882/1760] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:41.938734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:42.555747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:42.562062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:42.735191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36fb1c6-6d2b-4008-90d8-f1e27e4e6157 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:42.756654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:42.759469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:42.759746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:42.760104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] PATH_INFO: `/v3/projects/78715a5ed5cf414c9de7c0c6208b6518` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:42.767636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78715a5ed5cf414c9de7c0c6208b6518)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:42.770563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:43.260969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78715a5ed5cf414c9de7c0c6208b6518', 'request_id': 'req-8133c413-3540-4553-b4c3-5685f7c5d959'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:43.285142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78715a5ed5cf414c9de7c0c6208b6518', 'request_id': 'req-8133c413-3540-4553-b4c3-5685f7c5d959'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:43.399078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:43.402364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:43.441912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09572df8-f448-4a87-867c-1dcfda8e286e service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:43.596405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78715a5ed5cf414c9de7c0c6208b6518', 'request_id': 'req-8133c413-3540-4553-b4c3-5685f7c5d959'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:43.616623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:43.617374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:43.618098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:43.618098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] PATH_INFO: `/v3/projects/9da2b3060de64b659e64671ab3f2a445` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:43.619383 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da2b3060de64b659e64671ab3f2a445)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:43.620489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] The token cache is being invalidate because project 78715a5ed5cf414c9de7c0c6208b6518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:43.621490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:43.621653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:43.623072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8133c413-3540-4553-b4c3-5685f7c5d959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:43.629915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 879/1761] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:42 2022] DELETE /identity/v3/projects/78715a5ed5cf414c9de7c0c6208b6518 => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:43.632745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c990e-a144-4f8a-985d-a2e63b4b016f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:43.633485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c990e-a144-4f8a-985d-a2e63b4b016f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:43.634057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c990e-a144-4f8a-985d-a2e63b4b016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:43.661222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e71c990e-a144-4f8a-985d-a2e63b4b016f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:43.664322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e71c990e-a144-4f8a-985d-a2e63b4b016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:43.684960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 880/1762] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:43.688408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:43.690566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eaf54-d05d-4ef0-8d0a-b28bbee2a9c7 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:43.691061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eaf54-d05d-4ef0-8d0a-b28bbee2a9c7 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:43.691786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4eaf54-d05d-4ef0-8d0a-b28bbee2a9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:43.743082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-dc4eaf54-d05d-4ef0-8d0a-b28bbee2a9c7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:43.758035 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-dc4eaf54-d05d-4ef0-8d0a-b28bbee2a9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:43.794706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 881/1763] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:43.804152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4eaf54-d05d-4ef0-8d0a-b28bbee2a9c7 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:43.826885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4eaf54-d05d-4ef0-8d0a-b28bbee2a9c7 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:43.841925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:43.862157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da2b3060de64b659e64671ab3f2a445', 'request_id': 'req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:43.887599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da2b3060de64b659e64671ab3f2a445', 'request_id': 'req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:43.909821 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da2b3060de64b659e64671ab3f2a445', 'request_id': 'req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:44.003241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:44.004308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:44.004654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:44.005067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:44.005892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:44.006311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:44.012421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:44.033081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 882/1764] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:50:44.057583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:44.086901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2b0fd-40cb-47f4-b5ad-e7625719f942 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:44.108273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:44.112591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:44.113003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:44.113389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:44.114517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:44.117113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:44.257859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] The token cache is being invalidate because project 9da2b3060de64b659e64671ab3f2a445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:44.261892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:44.263734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-76d5f423-a1c0-4ead-a63a-3a0ba80c99dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:44.269720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 883/1765] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:43 2022] DELETE /identity/v3/projects/9da2b3060de64b659e64671ab3f2a445 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:50:44.277588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:44.278139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:44.278578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:44.350676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:44.354765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:44.363644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 883/1766] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:44 2022] POST /identity/v3/projects => generated 365 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:44.367633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:44.371735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:44.553887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 884/1767] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:44.571202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:44.585178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:44.623970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aae0a1-6547-46d5-a8f0-e061b50a046f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:44.643096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58bb146-b252-4951-be18-96f62b01b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:44.644236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb146-b252-4951-be18-96f62b01b884 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:44.644773 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb146-b252-4951-be18-96f62b01b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:44.646837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58bb146-b252-4951-be18-96f62b01b884 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:44.649044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bb146-b252-4951-be18-96f62b01b884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:44.655516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c93ee-f5b8-4271-adc8-a31a2aa29ef7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:44.657012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58bb146-b252-4951-be18-96f62b01b884 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:44.703812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:44.704612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:44.704902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:44.705415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] PATH_INFO: `/v3/users/9614b94b8ebe4cf59c216d5920743858` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:44.709143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9614b94b8ebe4cf59c216d5920743858)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:44.715514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:44.844176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 884/1768] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:44 2022] POST /identity/v3/users => generated 283 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:50:44.849662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fdaea-28e2-4b33-80bb-9c6c2162004d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:44.851537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fdaea-28e2-4b33-80bb-9c6c2162004d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:44.851864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fdaea-28e2-4b33-80bb-9c6c2162004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:44.905913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fa2fdaea-28e2-4b33-80bb-9c6c2162004d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:44.907382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fa2fdaea-28e2-4b33-80bb-9c6c2162004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:44.928401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 885/1769] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:44.935602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fdaea-28e2-4b33-80bb-9c6c2162004d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:44.968767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fdaea-28e2-4b33-80bb-9c6c2162004d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:44.986026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:44.986658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:44.986945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:44.987231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:44.990633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:44.995166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:45.028143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 886/1770] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:45.029280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:45.047616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9614b94b8ebe4cf59c216d5920743858'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:45.054568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2fd7-85ab-457c-b2e0-043b0819a76f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:45.055394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9614b94b8ebe4cf59c216d5920743858'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:45.079193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:45.079842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:45.080129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:45.080512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:45.082508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:45.082826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:45.085225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9614b94b8ebe4cf59c216d5920743858'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:45.086308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:45.130884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9614b94b8ebe4cf59c216d5920743858'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:45.135230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 887/1771] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:45.136403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:45.144996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:45.190622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cdb911-b764-474f-8a4c-f3678c632ab5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:45.197234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:45.197944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:45.198300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:45.201139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:45.202040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:45.213387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:45.230273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 888/1772] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:45.231325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:45.237107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:45.262554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce604ee4-2461-4ef7-92d3-f7f938960324 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:45.275442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e07e8-f604-4585-8b3a-98964604fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:45.280840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e07e8-f604-4585-8b3a-98964604fca5 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:45.280840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e07e8-f604-4585-8b3a-98964604fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:45.280840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e07e8-f604-4585-8b3a-98964604fca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:45.280840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e07e8-f604-4585-8b3a-98964604fca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:45.280840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e07e8-f604-4585-8b3a-98964604fca5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:45.390140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9614b94b8ebe4cf59c216d5920743858'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:45.433457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 885/1773] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:44 2022] DELETE /identity/v3/users/9614b94b8ebe4cf59c216d5920743858 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:45.437201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:45.444640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 889/1774] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:45 2022] POST /identity/v3/projects => generated 393 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:45.479215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388daf14-51af-478b-b847-8163937899b9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:45.480438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388daf14-51af-478b-b847-8163937899b9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:45.483344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388daf14-51af-478b-b847-8163937899b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:45.567202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-388daf14-51af-478b-b847-8163937899b9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:45.571146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-388daf14-51af-478b-b847-8163937899b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:45.608704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0989901b-a0b8-441b-8162-0cf52f9025d8 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:45.706682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:45.709209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:45.710075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:45.711910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] PATH_INFO: `/v3/projects/33399edc957d429695bc4e75056c42b7/users/2c66d05916734ea8abc5f2a3690d0c6e/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:45.750280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33399edc957d429695bc4e75056c42b7, user_id=2c66d05916734ea8abc5f2a3690d0c6e, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:45.754553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:45.774844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 890/1775] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:45.775957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388daf14-51af-478b-b847-8163937899b9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:45.786609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388daf14-51af-478b-b847-8163937899b9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:45.806599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ff06-c349-439e-ab78-af37d6d2357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:45.807301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ff06-c349-439e-ab78-af37d6d2357a admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:45.807561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ff06-c349-439e-ab78-af37d6d2357a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:45.808467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ff06-c349-439e-ab78-af37d6d2357a admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:45.809096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568ff06-c349-439e-ab78-af37d6d2357a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:45.811114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568ff06-c349-439e-ab78-af37d6d2357a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:45.848978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 886/1776] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:45 2022] PUT /identity/v3/projects/33399edc957d429695bc4e75056c42b7/users/2c66d05916734ea8abc5f2a3690d0c6e/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:45.850156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:45.863547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:45.936637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 891/1777] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:45 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:45.938050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd644d-0fd8-45bb-a9ef-2a87c29b95a8 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:45.938348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd644d-0fd8-45bb-a9ef-2a87c29b95a8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:45.938639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd644d-0fd8-45bb-a9ef-2a87c29b95a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:45.977341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-21fd644d-0fd8-45bb-a9ef-2a87c29b95a8 None None] MFA Rules not processed for user `2c66d05916734ea8abc5f2a3690d0c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:45.979692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-21fd644d-0fd8-45bb-a9ef-2a87c29b95a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:46.075601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770b6f-3e28-4c81-a583-212dfef73700 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:46.087366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:46.087994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:46.088299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:46.088579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:46.089399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 892/1778] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:46.091156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd644d-0fd8-45bb-a9ef-2a87c29b95a8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:46.305578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd644d-0fd8-45bb-a9ef-2a87c29b95a8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:46.311478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:46.313857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:46.321986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:46.325026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:46.325514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:46.325964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:46.328005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:46.332604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:46.348476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 887/1779] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:46.349073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:46.370975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e7a09e-0b0f-432a-b5f5-47f31bcd9350 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:46.377794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 893/1780] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:46.378799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:46.391124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e16478-b2c1-473d-a535-2a5271cb7094 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:46.394106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:46.394106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:46.394106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:46.396247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:46.396962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:46.397593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:46.398044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:46.398346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:46.399120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:46.400665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:46.401172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:46.409971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:46.450347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 894/1781] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:46.452186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:46.490038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918ab7-22a3-456d-b9c7-a86bd2d56295 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:46.494713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326f569-e81b-4a22-9e5e-97953f78d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:46.568982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326f569-e81b-4a22-9e5e-97953f78d2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:46.568982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326f569-e81b-4a22-9e5e-97953f78d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:46.568982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326f569-e81b-4a22-9e5e-97953f78d2ba admin admin] PATH_INFO: `/v3/projects/2b95876723cb4a069e932ba08f993f8a/users/9b4fb73acc584620aaf9fbbe08efe1d1/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:46.568982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326f569-e81b-4a22-9e5e-97953f78d2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b95876723cb4a069e932ba08f993f8a, user_id=9b4fb73acc584620aaf9fbbe08efe1d1, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:46.568982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326f569-e81b-4a22-9e5e-97953f78d2ba admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:46.973534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 895/1782] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:46 2022] PUT /identity/v3/projects/2b95876723cb4a069e932ba08f993f8a/users/9b4fb73acc584620aaf9fbbe08efe1d1/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:46.973534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5606ff-094d-4c42-b827-50d816b2885a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:46.973534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5606ff-094d-4c42-b827-50d816b2885a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:46.973534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5606ff-094d-4c42-b827-50d816b2885a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:46.976506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 888/1783] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:46 2022] POST /identity/v3/projects => generated 363 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:46.976506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:47.097481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8d5606ff-094d-4c42-b827-50d816b2885a None None] MFA Rules not processed for user `9b4fb73acc584620aaf9fbbe08efe1d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:47.098866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8d5606ff-094d-4c42-b827-50d816b2885a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:47.165384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53d768-b69e-4fb3-ba27-6d6060c16fba admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:47.220413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:47.222212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:47.223871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:47.227432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:47.239066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:47.257049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:47.263585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 896/1784] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:47.264566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5606ff-094d-4c42-b827-50d816b2885a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:47.288779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5606ff-094d-4c42-b827-50d816b2885a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:47.307097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:47.309068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:47.309383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:47.309718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:47.310394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:47.312581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:47.434558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 889/1785] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:46 2022] POST /identity/v3/users => generated 288 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:47.439211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:47.446725 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 897/1786] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:47 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:47.447765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:47.513970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb092ea-c504-4722-b5f0-c3671f261f19 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:47.624803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97fac-1b38-4c44-8707-d56b41213da2 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:47.638844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:47.640008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:47.640318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:47.640611 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:47.641278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:47.643301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:47.689777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:47.690628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:47.690926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:47.691211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:47.691883 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:47.705107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:47.729433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 890/1787] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:47.729433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:47.729433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:47.744428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5404d4-5b7b-4d1a-910e-60a41057284a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:47.749471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:47.750384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:47.751718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:47.752181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] PATH_INFO: `/v3/projects/39f505517a8c467180df305076144b85` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:47.757853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f505517a8c467180df305076144b85)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:47.765740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:47.827634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 898/1788] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:47 2022] POST /identity/v3/users => generated 301 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:47.828651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:47.854993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c80a5-7f72-4ca3-91bc-82fb75e7fe75 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:47.866727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:47.867423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:47.867740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:47.868019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] PATH_INFO: `/v3/projects/b4b0fbf9ed5945868934a9b4e45d3e61/users/335693704f0e4f86b7412cec0707cf77/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:47.886388 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b0fbf9ed5945868934a9b4e45d3e61, user_id=335693704f0e4f86b7412cec0707cf77, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:47.889278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.011668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 899/1789] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:47 2022] PUT /identity/v3/projects/b4b0fbf9ed5945868934a9b4e45d3e61/users/335693704f0e4f86b7412cec0707cf77/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:48.011668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.032426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f505517a8c467180df305076144b85', 'request_id': 'req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.042117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f505517a8c467180df305076144b85', 'request_id': 'req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.048167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f505517a8c467180df305076144b85', 'request_id': 'req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.099417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2c810-620b-47ff-91bf-8e55dd4815b6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.126079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] The token cache is being invalidate because project 39f505517a8c467180df305076144b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:48.126580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.128657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.130335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 891/1790] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:47 2022] DELETE /identity/v3/projects/39f505517a8c467180df305076144b85 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:48.131287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.142051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:48.192958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.194106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.194393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.195395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.196123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:48.197956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.219045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 900/1791] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:48.219740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.223038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:48.240519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c11ef9-81ef-45f5-9f29-748a9c649874 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.248004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0aac4-97a3-43fb-bf6d-7dfd4443ae27 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.269561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.271444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.272173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.272498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.272784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] PATH_INFO: `/v3/users/0d1a833a67724fc6bdb2db11f6596f9c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.273122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.273516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.273911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.277228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:48.277352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1a833a67724fc6bdb2db11f6596f9c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:48.280860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.281682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.303234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 892/1792] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:48.304235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.320915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:48.354967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e94fd-3af3-4769-9796-b8e69ca23623 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.360281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.361175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.361486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.361754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] PATH_INFO: `/v3/projects/e7db00e6e7924758b880de0c2e16e180/users/cd95addb6f25481f8595dfd6b98a5549/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.378542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7db00e6e7924758b880de0c2e16e180, user_id=cd95addb6f25481f8595dfd6b98a5549, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:48.380983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.554519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 893/1793] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:48 2022] PUT /identity/v3/projects/e7db00e6e7924758b880de0c2e16e180/users/cd95addb6f25481f8595dfd6b98a5549/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:48.554519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.613021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1a833a67724fc6bdb2db11f6596f9c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.613757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1a833a67724fc6bdb2db11f6596f9c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.614695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1a833a67724fc6bdb2db11f6596f9c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.629672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1a833a67724fc6bdb2db11f6596f9c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.635721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997eae7f-9bfa-435e-8d44-b028bf783deb admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.641584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.642501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.642977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.643440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] PATH_INFO: `/v3/projects/b4b0fbf9ed5945868934a9b4e45d3e61/users/335693704f0e4f86b7412cec0707cf77/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.647284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b0fbf9ed5945868934a9b4e45d3e61, user_id=335693704f0e4f86b7412cec0707cf77, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:48.650205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.669033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 894/1794] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:48 2022] PUT /identity/v3/projects/b4b0fbf9ed5945868934a9b4e45d3e61/users/335693704f0e4f86b7412cec0707cf77/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:48.679410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.680493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-48f10f5f-d7d1-45c3-bd9b-bacc4cd7949a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1a833a67724fc6bdb2db11f6596f9c'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:48.683850 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:48.696999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 901/1795] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:48 2022] DELETE /identity/v3/users/0d1a833a67724fc6bdb2db11f6596f9c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:48.699321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.699710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.700059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.730810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] MFA Rules not processed for user `335693704f0e4f86b7412cec0707cf77`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:48.732270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:48.772872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f721f-0c79-4e02-9534-3479c40dd221 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.826468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 902/1796] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:48.839766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.839766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:48.845324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.846739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.846739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.847114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.847779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:48.849670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.865219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 895/1797] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:48.867212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:48.878333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b50b676-ad95-4227-9ac4-caa3d3c07b30 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.884542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b2984d-0f8e-46df-9b25-43a4ac31d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.885582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2984d-0f8e-46df-9b25-43a4ac31d0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.885582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2984d-0f8e-46df-9b25-43a4ac31d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.886449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2984d-0f8e-46df-9b25-43a4ac31d0ef admin admin] PATH_INFO: `/v3/projects/e7db00e6e7924758b880de0c2e16e180/users/cd95addb6f25481f8595dfd6b98a5549/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.888504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2984d-0f8e-46df-9b25-43a4ac31d0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7db00e6e7924758b880de0c2e16e180, user_id=cd95addb6f25481f8595dfd6b98a5549, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:48.895903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b2984d-0f8e-46df-9b25-43a4ac31d0ef admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:48.905993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 896/1798] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:48 2022] PUT /identity/v3/projects/e7db00e6e7924758b880de0c2e16e180/users/cd95addb6f25481f8595dfd6b98a5549/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:48.912588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1795-c16b-4a95-b094-63c7cd984202 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:48.916244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.916546 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.916832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:48.956415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] MFA Rules not processed for user `cd95addb6f25481f8595dfd6b98a5549`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:48.957661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:48.975639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:48.976485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:48.976618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:48.976850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.061640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 897/1799] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:48 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:49.064968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:49.066687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:49.078137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:49.078808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 903/1800] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:50:49.081481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:49.099080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:49.105887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6270f356-f64f-47ca-97e2-3c89fdf2dac8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:49.117319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:49.117319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:49.117319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:49.117319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.136809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:49.146315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:49.146315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:49.163061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 898/1801] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:49.275751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:49.286118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945fd97-07d7-4e36-90da-9fd6aba1c6e0 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:49.309666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:49.310592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:49.311050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:49.311475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.325037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:49.328112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:49.339035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1bb47-b7d9-4985-a253-2bed5427776a service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:49.347437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea01e07-c3d5-4fcd-9987-667d31ef4116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:49.348072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01e07-c3d5-4fcd-9987-667d31ef4116 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:49.348390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01e07-c3d5-4fcd-9987-667d31ef4116 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:49.348673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea01e07-c3d5-4fcd-9987-667d31ef4116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.350670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2ea01e07-c3d5-4fcd-9987-667d31ef4116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:49.436299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:49.437935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:49.448909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 904/1802] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:49 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:49.449824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:49.451236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:49.460170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea01e07-c3d5-4fcd-9987-667d31ef4116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:49.462164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea01e07-c3d5-4fcd-9987-667d31ef4116 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:49.472634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 899/1803] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:50:49.542560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea440a16-f9ff-414e-9d1e-a0dbb6605bb5 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:49.549768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:49.551529 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:49.551910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:49.552303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] PATH_INFO: `/v3/projects/8797d66ad7ae4f2a8b1398bc02f5a5b2` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.553911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8797d66ad7ae4f2a8b1398bc02f5a5b2)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:49.557139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:49.684477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8797d66ad7ae4f2a8b1398bc02f5a5b2', 'request_id': 'req-4679e1a1-0e82-488d-bb26-17a75424d877'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:49.692123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8797d66ad7ae4f2a8b1398bc02f5a5b2', 'request_id': 'req-4679e1a1-0e82-488d-bb26-17a75424d877'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:49.820873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8797d66ad7ae4f2a8b1398bc02f5a5b2', 'request_id': 'req-4679e1a1-0e82-488d-bb26-17a75424d877'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:49.832826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] The token cache is being invalidate because project 8797d66ad7ae4f2a8b1398bc02f5a5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:49.833196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:49.833905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4679e1a1-0e82-488d-bb26-17a75424d877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:49.835509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 905/1804] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:49 2022] DELETE /identity/v3/projects/8797d66ad7ae4f2a8b1398bc02f5a5b2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:49.840521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a431-5f62-4f00-b547-29a7c3174ae7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:49.840918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a431-5f62-4f00-b547-29a7c3174ae7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:49.841270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05a431-5f62-4f00-b547-29a7c3174ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.869437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fa05a431-5f62-4f00-b547-29a7c3174ae7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:49.871151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fa05a431-5f62-4f00-b547-29a7c3174ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:49.927512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 900/1805] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:49.937023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0467840-1514-4785-ba7b-4e4a01df1460 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:49.939074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0467840-1514-4785-ba7b-4e4a01df1460 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:49.939074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0467840-1514-4785-ba7b-4e4a01df1460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.960178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f0467840-1514-4785-ba7b-4e4a01df1460 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:49.962140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f0467840-1514-4785-ba7b-4e4a01df1460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:49.971714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 906/1806] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:49.978049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a431-5f62-4f00-b547-29a7c3174ae7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:49.990841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05a431-5f62-4f00-b547-29a7c3174ae7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:49.996478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:49.997390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:49.997390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:49.997687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:49.998280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:49.998600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:50.000218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:50.012662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 901/1807] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:50:50.017258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0467840-1514-4785-ba7b-4e4a01df1460 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:50.027568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0467840-1514-4785-ba7b-4e4a01df1460 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:50.031983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:50.032750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:50.033139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:50.033666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:50.034416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:50.036442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:50.134304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 907/1808] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:50 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:50.137019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:50.145601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1707d-578c-4ed9-9728-6658131aab73 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:50.201862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:50.202766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:50.203059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:50.203333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:50.203983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:50.206210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:50.305124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 902/1809] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:50 2022] POST /identity/v3/users => generated 290 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:50.306700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:50.321701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5e61c-8c50-4cd3-949e-a8cd4d85bed3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:50.326354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:50.326986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:50.327271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:50.327554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:50.328223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:50.329831 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:50.340691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 908/1810] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:50.344800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:50.355597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf9320-1731-4be1-b264-ac64bcccb6e6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:50.360859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48555a05-f909-4644-ac88-0e7046aa6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:50.361465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555a05-f909-4644-ac88-0e7046aa6d56 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:50.364180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555a05-f909-4644-ac88-0e7046aa6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:50.364180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48555a05-f909-4644-ac88-0e7046aa6d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:50.364180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48555a05-f909-4644-ac88-0e7046aa6d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:50.364829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48555a05-f909-4644-ac88-0e7046aa6d56 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:50.376953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 903/1811] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:50.381384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:50.393526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c63c82-843b-4065-921b-21e2f31f4a36 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:50.399767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:50.400479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:50.400769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:50.401055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] PATH_INFO: `/v3/projects/1b5266e5be884f9193bc838914c47bfe/users/d96c4f701f764d4da75a1a049fe2ad6f/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:50.417857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5266e5be884f9193bc838914c47bfe, user_id=d96c4f701f764d4da75a1a049fe2ad6f, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:50.420559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:50.528438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f2e8-372f-41a3-99ec-ef91501b49e8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:50.528697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 909/1812] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:50 2022] PUT /identity/v3/projects/1b5266e5be884f9193bc838914c47bfe/users/d96c4f701f764d4da75a1a049fe2ad6f/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:50.528819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f2e8-372f-41a3-99ec-ef91501b49e8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:50.528998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702f2e8-372f-41a3-99ec-ef91501b49e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:50.572878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e702f2e8-372f-41a3-99ec-ef91501b49e8 None None] MFA Rules not processed for user `d96c4f701f764d4da75a1a049fe2ad6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:50.575903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e702f2e8-372f-41a3-99ec-ef91501b49e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:50.693154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 904/1813] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:50.697666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:50.805709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7beaa-9b5b-46c9-b81c-9903b2d04dce admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:50.813198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:50.814644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:50.815795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:50.816265 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:50.817106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:50.819200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:50.946707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 910/1814] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:50 2022] POST /identity/v3/projects => generated 377 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:50.950941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f2e8-372f-41a3-99ec-ef91501b49e8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:50.964584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702f2e8-372f-41a3-99ec-ef91501b49e8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:51.044654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:51.045650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:51.046045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:51.046594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:51.047834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:51.050559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:51.092282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:51.146719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 905/1815] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:50 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:51.151683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:51.164417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef5bb-cdfd-4cf7-a6fd-16128c740038 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:51.175479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:51.185812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:51.186730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:51.187168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:51.187649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:51.189028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:51.192899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:51.210748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 911/1816] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:51.215768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:51.232247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3d17b-33b2-4dee-b8f2-3adbece56d97 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:51.238756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:51.239746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:51.239982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:51.240372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] PATH_INFO: `/v3/projects/c82f882898004ee4b0a7776613bc6e25/users/eef4ff5f50d3461795d9cfda0fc45cae/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:51.258200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82f882898004ee4b0a7776613bc6e25, user_id=eef4ff5f50d3461795d9cfda0fc45cae, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:51.261668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:51.393338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 906/1817] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:51 2022] PUT /identity/v3/projects/c82f882898004ee4b0a7776613bc6e25/users/eef4ff5f50d3461795d9cfda0fc45cae/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:51.397275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:51.416496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86c4bd-2e38-494d-be4d-51a5532a0307 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:51.525215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f417a-b13d-4ab3-aeac-6d05d93a880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:51.525861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f417a-b13d-4ab3-aeac-6d05d93a880c admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:51.526745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f417a-b13d-4ab3-aeac-6d05d93a880c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:51.527170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f417a-b13d-4ab3-aeac-6d05d93a880c admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:51.527839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f417a-b13d-4ab3-aeac-6d05d93a880c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:51.529589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f417a-b13d-4ab3-aeac-6d05d93a880c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:51.539836 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 912/1818] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:50:51.544793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:51.555094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d2885-31e7-4edb-a9e3-4e47ed693ecc admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:51.559725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:51.561538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:51.561538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:51.561538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] PATH_INFO: `/v3/projects/c82f882898004ee4b0a7776613bc6e25/users/eef4ff5f50d3461795d9cfda0fc45cae/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:51.562914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82f882898004ee4b0a7776613bc6e25, user_id=eef4ff5f50d3461795d9cfda0fc45cae, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:51.565630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:51.576080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 907/1819] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:51 2022] PUT /identity/v3/projects/c82f882898004ee4b0a7776613bc6e25/users/eef4ff5f50d3461795d9cfda0fc45cae/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:51.587520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812addf7-f46e-47e5-9ff0-7f586600adc6 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:51.590216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812addf7-f46e-47e5-9ff0-7f586600adc6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:51.590216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812addf7-f46e-47e5-9ff0-7f586600adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:51.637700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-812addf7-f46e-47e5-9ff0-7f586600adc6 None None] MFA Rules not processed for user `eef4ff5f50d3461795d9cfda0fc45cae`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:51.639221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-812addf7-f46e-47e5-9ff0-7f586600adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:51.724425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 913/1820] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:51.868619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:51.870390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:51.943049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b35b8-4ada-4b60-a3bf-7661404dd041 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:51.947639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d44f3fe-ec24-45fd-b453-75863c9545e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:51.948975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44f3fe-ec24-45fd-b453-75863c9545e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:51.949287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44f3fe-ec24-45fd-b453-75863c9545e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:51.949534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44f3fe-ec24-45fd-b453-75863c9545e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:52.041594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44f3fe-ec24-45fd-b453-75863c9545e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:52.041594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d44f3fe-ec24-45fd-b453-75863c9545e2 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:52.064714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 908/1821] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:52.835422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:53.603896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:54.008637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812addf7-f46e-47e5-9ff0-7f586600adc6 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:54.029156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812addf7-f46e-47e5-9ff0-7f586600adc6 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:54.033758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cc686-8ef1-486c-83ec-84d20714a5bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:54.034475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc686-8ef1-486c-83ec-84d20714a5bc service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:54.036516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc686-8ef1-486c-83ec-84d20714a5bc service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:54.036516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cc686-8ef1-486c-83ec-84d20714a5bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:54.045094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cc686-8ef1-486c-83ec-84d20714a5bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:54.046664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cc686-8ef1-486c-83ec-84d20714a5bc service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:54.058319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 914/1822] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:55.004751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e4d10-fd94-4c02-8a7a-70b2bd0d7c03 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:55.005391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e4d10-fd94-4c02-8a7a-70b2bd0d7c03 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:55.005391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e4d10-fd94-4c02-8a7a-70b2bd0d7c03 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:55.006701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 909/1823] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:50:55.020044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:55.022234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:55.022234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:55.049733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:55.051059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:55.155889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 915/1824] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:50:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:55.169617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e4d10-fd94-4c02-8a7a-70b2bd0d7c03 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:55.172044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-483e4d10-fd94-4c02-8a7a-70b2bd0d7c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:55.195041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e4d10-fd94-4c02-8a7a-70b2bd0d7c03 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:55.202705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d00d5-8fad-461e-95a0-f48aa5a97e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:55.208089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d00d5-8fad-461e-95a0-f48aa5a97e25 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:55.208089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d00d5-8fad-461e-95a0-f48aa5a97e25 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:55.208089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d00d5-8fad-461e-95a0-f48aa5a97e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:55.218948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d00d5-8fad-461e-95a0-f48aa5a97e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:55.221133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d00d5-8fad-461e-95a0-f48aa5a97e25 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:55.236851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 910/1825] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:55.239621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:55.246955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:55.335362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e5940-7012-4cc9-adfa-3b3241fcaafb None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:55.342326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:55.343176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:55.343886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:55.344272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:55.344621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] PATH_INFO: `/v3/users/9b4fb73acc584620aaf9fbbe08efe1d1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:55.345936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4fb73acc584620aaf9fbbe08efe1d1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:55.348053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:55.378174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:55.543156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4fb73acc584620aaf9fbbe08efe1d1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:55.543738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4fb73acc584620aaf9fbbe08efe1d1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:55.544399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4fb73acc584620aaf9fbbe08efe1d1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:55.558021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4fb73acc584620aaf9fbbe08efe1d1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:55.641020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4fb73acc584620aaf9fbbe08efe1d1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:55.657757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 916/1826] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:55 2022] DELETE /identity/v3/users/9b4fb73acc584620aaf9fbbe08efe1d1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:55.662286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:55.666096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:55.666096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:55.689409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:55.689409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:55.778610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 911/1827] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:55.791793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:55.793996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:55.903923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc51820-b90d-42e9-83a5-c95bf8e94adf admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:55.908962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:55.909862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:55.910205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:55.910490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:55.922241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:55.923700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:55.940055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 917/1828] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:56.717849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:56.718385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:56.732013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae35cb0-6a8b-4d80-8235-84384f4168b7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:56.737414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:56.738056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:56.738341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:56.738623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] PATH_INFO: `/v3/projects/2b95876723cb4a069e932ba08f993f8a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:56.739824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b95876723cb4a069e932ba08f993f8a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:56.741868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:56.917265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b95876723cb4a069e932ba08f993f8a', 'request_id': 'req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:56.923864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b95876723cb4a069e932ba08f993f8a', 'request_id': 'req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:56.929822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b95876723cb4a069e932ba08f993f8a', 'request_id': 'req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.028972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] The token cache is being invalidate because project 2b95876723cb4a069e932ba08f993f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:57.029270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.029912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.031481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 912/1829] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:56 2022] DELETE /identity/v3/projects/2b95876723cb4a069e932ba08f993f8a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:57.035462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:57.045030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cdc19-9e8a-452b-af47-6c11420e0243 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:57.099468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:57.100100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:57.100415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:57.100699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] PATH_INFO: `/v3/users/cd95addb6f25481f8595dfd6b98a5549` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:57.101822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd95addb6f25481f8595dfd6b98a5549)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:57.103746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:57.309214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd95addb6f25481f8595dfd6b98a5549'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.309950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd95addb6f25481f8595dfd6b98a5549'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.310730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd95addb6f25481f8595dfd6b98a5549'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.324571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd95addb6f25481f8595dfd6b98a5549'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.414543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd95addb6f25481f8595dfd6b98a5549'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:57.428113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 918/1830] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:57 2022] DELETE /identity/v3/users/cd95addb6f25481f8595dfd6b98a5549 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:57.695103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:57.740855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:50:58.118357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:58.118357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:58.136813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8cac7-050f-412d-9c1c-592a7d0efdd5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:58.208633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:58.209323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.209608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.209939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] PATH_INFO: `/v3/projects/e7db00e6e7924758b880de0c2e16e180` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.211176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7db00e6e7924758b880de0c2e16e180)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:58.213697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:58.331881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:58.334253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:58.348491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254549d-4d14-4134-b4f6-f44bc0400fa0 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:58.354458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:58.355104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.355392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.355672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] PATH_INFO: `/v3/users/2c66d05916734ea8abc5f2a3690d0c6e` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.356843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c66d05916734ea8abc5f2a3690d0c6e)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:58.359020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:58.493806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7db00e6e7924758b880de0c2e16e180', 'request_id': 'req-0906b22d-a066-4cff-baa4-176eb8eb352c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.499934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7db00e6e7924758b880de0c2e16e180', 'request_id': 'req-0906b22d-a066-4cff-baa4-176eb8eb352c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.505445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7db00e6e7924758b880de0c2e16e180', 'request_id': 'req-0906b22d-a066-4cff-baa4-176eb8eb352c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.577728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] The token cache is being invalidate because project e7db00e6e7924758b880de0c2e16e180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:58.584140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.584140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0906b22d-a066-4cff-baa4-176eb8eb352c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.584140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 913/1831] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:58 2022] DELETE /identity/v3/projects/e7db00e6e7924758b880de0c2e16e180 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:58.586298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6835e5-dc65-4dc1-ba7d-16508d98d62a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.586765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6835e5-dc65-4dc1-ba7d-16508d98d62a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.587045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6835e5-dc65-4dc1-ba7d-16508d98d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.609882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2b6835e5-dc65-4dc1-ba7d-16508d98d62a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:58.611197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2b6835e5-dc65-4dc1-ba7d-16508d98d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:58.654879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c66d05916734ea8abc5f2a3690d0c6e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.656050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c66d05916734ea8abc5f2a3690d0c6e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.657316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c66d05916734ea8abc5f2a3690d0c6e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.675198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c66d05916734ea8abc5f2a3690d0c6e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.693413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 914/1832] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:58.702184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9ce6-cfbd-4a69-8551-26f3160c7689 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.702480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9ce6-cfbd-4a69-8551-26f3160c7689 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.702772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f9ce6-cfbd-4a69-8551-26f3160c7689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.724337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ab9f9ce6-cfbd-4a69-8551-26f3160c7689 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:58.725589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ab9f9ce6-cfbd-4a69-8551-26f3160c7689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:58.733744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 915/1833] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:58.739137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9ce6-cfbd-4a69-8551-26f3160c7689 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:58.749341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f9ce6-cfbd-4a69-8551-26f3160c7689 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:58.754174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:58.754695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-42bf8317-a42e-4b81-99f3-c0c7748b2f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c66d05916734ea8abc5f2a3690d0c6e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:58.754823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.755073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.755353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.756185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:50:58.756403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:58.758045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:58.769959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 919/1834] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:58 2022] DELETE /identity/v3/users/2c66d05916734ea8abc5f2a3690d0c6e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:58.774834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.775192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.775480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.790686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 916/1835] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:50:58.791820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:58.802663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:58.803899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc83891-3740-4028-885a-8aac7ba750d3 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:58.804014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:58.871429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:58.872059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.872454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.872856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.873517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:58.875594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:58.876498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 920/1836] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:58.894868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:58.897667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:58.968553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfadc6-d4ae-4520-9cca-286447d0edca None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:58.977499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:58.978192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:58.988355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:58.988355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:58.996362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:58.998262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.018709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 917/1837] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:58 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:59.018709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.023718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:59.030826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 921/1838] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:59.031673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.042498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe4500-518e-43fe-9987-3fceb66d9945 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.160556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d590c-dc1c-411f-a76b-d64435211f2e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.161953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.163154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.163546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.163967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.167069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.169822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.172645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.177744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.178362 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.179037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] PATH_INFO: `/v3/users/d96c4f701f764d4da75a1a049fe2ad6f` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.182730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d96c4f701f764d4da75a1a049fe2ad6f)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.187440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.264056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 922/1839] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:59 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:59.272551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.280316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798d75e-850e-434d-a4df-f91aa6ea43ff admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.288929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.289549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.289854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.290165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.290978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.293214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.305175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 923/1840] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:50:59.309438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.319374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062bc60-a117-4f71-bd28-0f7b2c66907a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.324641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.325257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.326928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.326928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.326928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.328050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.340250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 924/1841] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:50:59.343283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.356641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba71e1-6f19-431d-876d-8edc6f5120f6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.361730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7754f4c-ea77-43d1-9bec-e8220d2e5896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.362466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754f4c-ea77-43d1-9bec-e8220d2e5896 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.362866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754f4c-ea77-43d1-9bec-e8220d2e5896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.363313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7754f4c-ea77-43d1-9bec-e8220d2e5896 admin admin] PATH_INFO: `/v3/projects/2d6db33ffbac4f078a419420b6e824f0/users/44d07ce7c99d4cac8d8638dfdb09cc9d/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.386209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7754f4c-ea77-43d1-9bec-e8220d2e5896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6db33ffbac4f078a419420b6e824f0, user_id=44d07ce7c99d4cac8d8638dfdb09cc9d, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.388949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7754f4c-ea77-43d1-9bec-e8220d2e5896 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.432410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd96c4f701f764d4da75a1a049fe2ad6f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.433218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd96c4f701f764d4da75a1a049fe2ad6f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.433951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd96c4f701f764d4da75a1a049fe2ad6f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.442261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd96c4f701f764d4da75a1a049fe2ad6f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.501368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 925/1842] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:50:59 2022] PUT /identity/v3/projects/2d6db33ffbac4f078a419420b6e824f0/users/44d07ce7c99d4cac8d8638dfdb09cc9d/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:50:59.516543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.520185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.520185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.521558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86477153-cba4-4254-9614-6245331ff112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd96c4f701f764d4da75a1a049fe2ad6f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.545210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 918/1843] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:59 2022] DELETE /identity/v3/users/d96c4f701f764d4da75a1a049fe2ad6f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:59.552612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.553177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.553669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.564183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] MFA Rules not processed for user `44d07ce7c99d4cac8d8638dfdb09cc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:59.565563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:59.576714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:50:59.580224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:59.659528 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 919/1844] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:50:59.660469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.661932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:59.678140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2f520-544e-4228-b795-8b2a503c8e1b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.679772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 926/1845] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:50:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:50:59.680945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.683385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:59.685965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.686855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.687355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.687824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] PATH_INFO: `/v3/projects/33399edc957d429695bc4e75056c42b7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.689249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33399edc957d429695bc4e75056c42b7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.691634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.761635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245121ab-2318-40b7-b315-f484b3bd92c3 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.767005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.767784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.768176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.768591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.782412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.784014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.797052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 927/1846] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:50:59.798107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.799746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:50:59.815513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb4b2a-c8e4-406c-9850-e398355e324d service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:50:59.830353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:50:59.831228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:50:59.831514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:50:59.831856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:50:59.832527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:50:59.834695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:50:59.867459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33399edc957d429695bc4e75056c42b7', 'request_id': 'req-de33a1bd-90ab-421c-9834-b8be7a40fe21'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.875174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33399edc957d429695bc4e75056c42b7', 'request_id': 'req-de33a1bd-90ab-421c-9834-b8be7a40fe21'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.882388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33399edc957d429695bc4e75056c42b7', 'request_id': 'req-de33a1bd-90ab-421c-9834-b8be7a40fe21'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.922063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 928/1847] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:50:59 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:50:59.926048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.946080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] The token cache is being invalidate because project 33399edc957d429695bc4e75056c42b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:50:59.946382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.948237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:50:59.952632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 920/1848] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:50:59 2022] DELETE /identity/v3/projects/33399edc957d429695bc4e75056c42b7 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:50:59.953917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:50:59.957644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:00.040240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33a1bd-90ab-421c-9834-b8be7a40fe21 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.045125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452220c-3189-4e25-9c01-666110127fbb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.045803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.046704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.047202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.047694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] PATH_INFO: `/v3/users/335693704f0e4f86b7412cec0707cf77` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.049264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335693704f0e4f86b7412cec0707cf77)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.051489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.051828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.052653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.053066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.053394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.054034 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.056097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.163860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 929/1849] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:50:59 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:00.165124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:00.166898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:00.202609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7c4fc-4a64-4d91-a9d1-c2602c5228c0 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.224807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.225905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.226186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.226466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.227133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.229477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.248233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 930/1850] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:00.252001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:00.267145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055466d-9f58-4b9c-aa06-3cc45d67c0a9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.280289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.281433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.282006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.282454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.283721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.285825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.297471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335693704f0e4f86b7412cec0707cf77'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.299826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335693704f0e4f86b7412cec0707cf77'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.301054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335693704f0e4f86b7412cec0707cf77'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.309191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 931/1851] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:00.313558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:00.316520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335693704f0e4f86b7412cec0707cf77'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.316656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:00.346554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17121278-8f42-471d-b2a4-f19f5ce75d9b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.357618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88820394-cfd3-42f2-a678-31ea674c40ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.358298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820394-cfd3-42f2-a678-31ea674c40ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.358583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820394-cfd3-42f2-a678-31ea674c40ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.359290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88820394-cfd3-42f2-a678-31ea674c40ad admin admin] PATH_INFO: `/v3/projects/1b9544f2596747a6969f994c08c37102/users/4e96a2ed69cd4402b1973567cd664bf5/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.376647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820394-cfd3-42f2-a678-31ea674c40ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9544f2596747a6969f994c08c37102, user_id=4e96a2ed69cd4402b1973567cd664bf5, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.379329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88820394-cfd3-42f2-a678-31ea674c40ad admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.388012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335693704f0e4f86b7412cec0707cf77'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.408517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 921/1852] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:50:59 2022] DELETE /identity/v3/users/335693704f0e4f86b7412cec0707cf77 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:00.412059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:00.413451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:00.478012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 932/1853] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:00 2022] PUT /identity/v3/projects/1b9544f2596747a6969f994c08c37102/users/4e96a2ed69cd4402b1973567cd664bf5/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:00.488820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5fa10-39b6-427e-8e4c-4c4cf47b5d72 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.489281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5fa10-39b6-427e-8e4c-4c4cf47b5d72 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.489704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5fa10-39b6-427e-8e4c-4c4cf47b5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.528886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a2b5fa10-39b6-427e-8e4c-4c4cf47b5d72 None None] MFA Rules not processed for user `4e96a2ed69cd4402b1973567cd664bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:00.531030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a2b5fa10-39b6-427e-8e4c-4c4cf47b5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:00.534228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14ce983-5ea2-4dfd-8070-7e4b4fdb66e4 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.671538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.673129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.673688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.674191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] PATH_INFO: `/v3/projects/1b5266e5be884f9193bc838914c47bfe` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.675956 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5266e5be884f9193bc838914c47bfe)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.678025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.695596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 933/1854] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:00.698612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5fa10-39b6-427e-8e4c-4c4cf47b5d72 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:00.714486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5fa10-39b6-427e-8e4c-4c4cf47b5d72 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.720285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.720920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.721208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.721505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.722279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.724438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.821590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5266e5be884f9193bc838914c47bfe', 'request_id': 'req-f7375078-e398-473f-bb88-d3392872ee1e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.830122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5266e5be884f9193bc838914c47bfe', 'request_id': 'req-f7375078-e398-473f-bb88-d3392872ee1e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.837037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5266e5be884f9193bc838914c47bfe', 'request_id': 'req-f7375078-e398-473f-bb88-d3392872ee1e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.869068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 934/1855] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:00 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:00.870639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:00.948715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4775ce-2757-472f-a75d-bc3b1d07a9ee admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:00.953673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:00.954398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:00.954764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:00.955142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:00.956321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:00.958483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:00.960855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] The token cache is being invalidate because project 1b5266e5be884f9193bc838914c47bfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:00.964538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.964538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:00.964538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 922/1856] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:00 2022] DELETE /identity/v3/projects/1b5266e5be884f9193bc838914c47bfe => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:00.967700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:00.969702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:01.041044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7375078-e398-473f-bb88-d3392872ee1e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:01.048235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 935/1857] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:00 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:01.049167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:01.049835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:01.049980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:01.050143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:01.050398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] PATH_INFO: `/v3/users/eef4ff5f50d3461795d9cfda0fc45cae` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:01.051584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef4ff5f50d3461795d9cfda0fc45cae)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:01.053619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:01.058840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:01.082041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c51e7-6cee-46d7-b9f2-3ef94c00a903 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:01.091582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:01.092654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:01.093896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:01.094551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] PATH_INFO: `/v3/projects/b4b0fbf9ed5945868934a9b4e45d3e61` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:01.096002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b0fbf9ed5945868934a9b4e45d3e61)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:01.100215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:01.351755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef4ff5f50d3461795d9cfda0fc45cae'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.352730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef4ff5f50d3461795d9cfda0fc45cae'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.354304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef4ff5f50d3461795d9cfda0fc45cae'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.354577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b0fbf9ed5945868934a9b4e45d3e61', 'request_id': 'req-56b1322c-b4c1-4840-aeb9-38d271b44fd7'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.363071 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b0fbf9ed5945868934a9b4e45d3e61', 'request_id': 'req-56b1322c-b4c1-4840-aeb9-38d271b44fd7'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.376873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef4ff5f50d3461795d9cfda0fc45cae'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.528896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b0fbf9ed5945868934a9b4e45d3e61', 'request_id': 'req-56b1322c-b4c1-4840-aeb9-38d271b44fd7'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.542219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] The token cache is being invalidate because project b4b0fbf9ed5945868934a9b4e45d3e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:01.542767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.543675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.545807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 936/1858] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:01 2022] DELETE /identity/v3/projects/b4b0fbf9ed5945868934a9b4e45d3e61 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:01.546784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:01.552299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:01.632618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:01.637100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-711fddd5-a90f-4c21-9899-ae5607c184fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef4ff5f50d3461795d9cfda0fc45cae'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:01.710426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 923/1859] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:00 2022] DELETE /identity/v3/users/eef4ff5f50d3461795d9cfda0fc45cae => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:01.712083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0dbd-5ede-4051-b978-3b45a69bcac9 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:01.712564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0dbd-5ede-4051-b978-3b45a69bcac9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:01.713050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be0dbd-5ede-4051-b978-3b45a69bcac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:01.744969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1322c-b4c1-4840-aeb9-38d271b44fd7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:01.757111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-08be0dbd-5ede-4051-b978-3b45a69bcac9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:01.758362 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-08be0dbd-5ede-4051-b978-3b45a69bcac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:01.779468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:01.871479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 924/1860] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:01.880089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02df543-68f1-41f9-9c11-fe5a1a5a9e3d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:01.884086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02df543-68f1-41f9-9c11-fe5a1a5a9e3d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:01.884086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02df543-68f1-41f9-9c11-fe5a1a5a9e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:01.894063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:01.894827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:01.895207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:01.895605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:01.896448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:01.898815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:01.912868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d02df543-68f1-41f9-9c11-fe5a1a5a9e3d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:01.914834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d02df543-68f1-41f9-9c11-fe5a1a5a9e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:01.923528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 937/1861] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:01.928244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 925/1862] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:01.933097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:01.935040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02df543-68f1-41f9-9c11-fe5a1a5a9e3d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:01.954902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02df543-68f1-41f9-9c11-fe5a1a5a9e3d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:01.969385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:01.970561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:01.971931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:01.972252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:01.976001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:01.976001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:01.977408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:01.979060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05fd71-ed4a-4d6a-a952-fbea5b507539 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.001399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 926/1863] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:02.006320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.019382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9c539-e7ce-4bba-87c4-e819de9d5487 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.025018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.025897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.026228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.026516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.027164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.029350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.035818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.036670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.036964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.037437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] PATH_INFO: `/v3/projects/a42d4dbb17c04b6cabec87c1a1ee0d26/users/140d9fcd74b94c32b3af1a16d55c7a4a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.070402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42d4dbb17c04b6cabec87c1a1ee0d26, user_id=140d9fcd74b94c32b3af1a16d55c7a4a, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.074306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.178533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 927/1864] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:02 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:02.184701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.213859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 938/1865] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:01 2022] PUT /identity/v3/projects/a42d4dbb17c04b6cabec87c1a1ee0d26/users/140d9fcd74b94c32b3af1a16d55c7a4a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:02.219234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.272806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8481c7-9417-4693-bcd9-e690d236eb86 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.352163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b2e5c2-abc6-4649-8111-86d22dfb097b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.366104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.366839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.367366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.367748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.368572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.370109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.371064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.371366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.378142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.378544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.378642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.378642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.387050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 939/1866] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:02.393328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.405082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78ae24-d4a5-4937-8ec1-d15b664b99d9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.411087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc467e3-39be-484b-923f-9aa18d42142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.412013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc467e3-39be-484b-923f-9aa18d42142e admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.412346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc467e3-39be-484b-923f-9aa18d42142e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.412632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc467e3-39be-484b-923f-9aa18d42142e admin admin] PATH_INFO: `/v3/projects/a42d4dbb17c04b6cabec87c1a1ee0d26/users/140d9fcd74b94c32b3af1a16d55c7a4a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.415105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc467e3-39be-484b-923f-9aa18d42142e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42d4dbb17c04b6cabec87c1a1ee0d26, user_id=140d9fcd74b94c32b3af1a16d55c7a4a, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.421585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc467e3-39be-484b-923f-9aa18d42142e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.444994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 940/1867] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:02 2022] PUT /identity/v3/projects/a42d4dbb17c04b6cabec87c1a1ee0d26/users/140d9fcd74b94c32b3af1a16d55c7a4a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:02.446626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.446925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.447212 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.485730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 928/1868] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:02 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:02.488302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] MFA Rules not processed for user `140d9fcd74b94c32b3af1a16d55c7a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:02.490458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:02.490921 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.505426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990c19-f431-4b58-b15d-0ccbb7f430b0 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.574956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 941/1869] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:02.589708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.591100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:02.592719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.593506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.593975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.594330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.595135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.596867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.608568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 929/1870] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:02.612658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.623474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba34ef6-eba9-4834-a486-3e69c94ffa48 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.629609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.630279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.630693 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.631077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.631827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.633603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.648393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 930/1871] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:02.649447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.654694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0728509-87a5-4878-8dc4-ce11ccf87c39 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.658762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.659422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.659709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.660007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.664737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3afc62-0ba6-4f04-9026-3983d2db9215 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.670861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d4651-fc64-4933-a1b0-3279b8adbd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.671426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.671712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4651-fc64-4933-a1b0-3279b8adbd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.672069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4651-fc64-4933-a1b0-3279b8adbd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.672448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d4651-fc64-4933-a1b0-3279b8adbd96 admin admin] PATH_INFO: `/v3/projects/b16422d775e54cc790f3f183d435189a/users/284e4b0159974c9e851159368d5105fe/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.672985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.683899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 942/1872] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:02.696134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.696134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:02.699425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d4651-fc64-4933-a1b0-3279b8adbd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16422d775e54cc790f3f183d435189a, user_id=284e4b0159974c9e851159368d5105fe, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.705178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d4651-fc64-4933-a1b0-3279b8adbd96 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.717453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf32e7a-10a8-4f7b-b86f-8ca6a485fe1a service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:02.722401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:02.723047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.723429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.723709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] PATH_INFO: `/v3/projects/c82f882898004ee4b0a7776613bc6e25` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.724910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82f882898004ee4b0a7776613bc6e25)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:02.728894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:02.827198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 931/1873] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:02 2022] PUT /identity/v3/projects/b16422d775e54cc790f3f183d435189a/users/284e4b0159974c9e851159368d5105fe/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:02.829790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:02.830068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:02.830347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:02.856319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82f882898004ee4b0a7776613bc6e25', 'request_id': 'req-649d5baa-8d86-40b8-9885-a4793c3b9a31'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:02.863032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82f882898004ee4b0a7776613bc6e25', 'request_id': 'req-649d5baa-8d86-40b8-9885-a4793c3b9a31'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:02.863356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] MFA Rules not processed for user `284e4b0159974c9e851159368d5105fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:02.865586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:02.940512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 932/1874] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:02.940512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.940512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:02.966313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82f882898004ee4b0a7776613bc6e25', 'request_id': 'req-649d5baa-8d86-40b8-9885-a4793c3b9a31'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:02.979078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] The token cache is being invalidate because project c82f882898004ee4b0a7776613bc6e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:02.979417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:02.980081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:02.985015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 943/1875] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:02 2022] DELETE /identity/v3/projects/c82f882898004ee4b0a7776613bc6e25 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:02.985015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:02.985279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:03.007122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aee9a-f1db-4169-9159-4030b01004cf None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.012927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf9411-46de-4318-9f9e-43df553b00ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.013742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9411-46de-4318-9f9e-43df553b00ee service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.014077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9411-46de-4318-9f9e-43df553b00ee service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.014471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf9411-46de-4318-9f9e-43df553b00ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.016962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-05cf9411-46de-4318-9f9e-43df553b00ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:03.054918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d5baa-8d86-40b8-9885-a4793c3b9a31 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.061403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.062146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.062547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.062876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.063578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.074167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.088435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf9411-46de-4318-9f9e-43df553b00ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.089901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf9411-46de-4318-9f9e-43df553b00ee service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.103233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 933/1876] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:03.105121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540f411-521f-4fbd-9b7b-c6e87fe36a34 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.105374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540f411-521f-4fbd-9b7b-c6e87fe36a34 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.105658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540f411-521f-4fbd-9b7b-c6e87fe36a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.127476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c540f411-521f-4fbd-9b7b-c6e87fe36a34 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:03.129512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c540f411-521f-4fbd-9b7b-c6e87fe36a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:03.142596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 934/1877] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:03.154036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69948f3f-0001-4b5d-bd55-836e088fc97b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.154339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69948f3f-0001-4b5d-bd55-836e088fc97b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.154635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69948f3f-0001-4b5d-bd55-836e088fc97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.181356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-69948f3f-0001-4b5d-bd55-836e088fc97b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:03.194316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-69948f3f-0001-4b5d-bd55-836e088fc97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:03.194842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 944/1878] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:02 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:03.197216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.299599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 935/1879] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:03.305120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69948f3f-0001-4b5d-bd55-836e088fc97b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.318437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69948f3f-0001-4b5d-bd55-836e088fc97b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.341081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.344637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.345046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.346009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.347877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:03.349221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.353270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.401480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e3285-4e93-4e5a-b3c8-b543c7bd8764 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.404639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 936/1880] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:03.408243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.410653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.411348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.411639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.411921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.412603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.420448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.433267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff9b5f-a9b1-4f35-9218-7f7171e8971e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.457762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.458471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.458699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.458980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.459627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.461605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.561587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 945/1881] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:03 2022] POST /identity/v3/users => generated 298 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:03.570194 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.580858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede86eba-e34f-45bb-8d8d-61b6fa0368ae admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.587061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.587643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.588523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.588879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.589611 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.591615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.603538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 937/1882] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:03 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:03.604721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.609553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 946/1883] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:03.614222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.626783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc361975-951f-4f6b-90e6-341973b4aad3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.724978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.725852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.726146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.726431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] PATH_INFO: `/v3/projects/a6b8dd651f504280b4576120f26f7f6c/users/334ef239a5874b54911f46596c560bd0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.746908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b8dd651f504280b4576120f26f7f6c, user_id=334ef239a5874b54911f46596c560bd0, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.750400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.754966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbb5ee-552a-4ad8-96e6-e976bab18e97 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.760499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.761247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.761623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.762084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.762728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.764756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.832590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 947/1884] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:03 2022] PUT /identity/v3/projects/a6b8dd651f504280b4576120f26f7f6c/users/334ef239a5874b54911f46596c560bd0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:03.834655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.851966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:03.861061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 938/1885] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:03 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:03.870120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.880564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4e7f1-40e5-4c14-8ee3-a28cf5edc0dd admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.899912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d49d1-38e7-48f1-95c4-33d8d987170b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.905170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.905782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.906090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.906363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.907140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.908780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.932751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 948/1886] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:03.933850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.943976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe263-cde3-46a8-9556-72534ff12873 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.946652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.947881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.949475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.949760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.950428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.952080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.955984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869b549-e38c-49a5-b779-717a3fd65c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:03.959693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b549-e38c-49a5-b779-717a3fd65c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.959693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b549-e38c-49a5-b779-717a3fd65c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.959693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869b549-e38c-49a5-b779-717a3fd65c1c admin admin] PATH_INFO: `/v3/projects/a6b8dd651f504280b4576120f26f7f6c/users/334ef239a5874b54911f46596c560bd0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:03.959995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869b549-e38c-49a5-b779-717a3fd65c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b8dd651f504280b4576120f26f7f6c, user_id=334ef239a5874b54911f46596c560bd0, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:03.962706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869b549-e38c-49a5-b779-717a3fd65c1c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:03.963456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 939/1887] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:03.967438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:03.986974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 949/1888] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:03 2022] PUT /identity/v3/projects/a6b8dd651f504280b4576120f26f7f6c/users/334ef239a5874b54911f46596c560bd0/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:03.987689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9355a961-ec90-474a-afe7-421188b4ce0d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:03.988633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:03.988922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:03.989200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.018345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] MFA Rules not processed for user `334ef239a5874b54911f46596c560bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:04.019527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:04.037850 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.038467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.038752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.039038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.039684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.041311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:04.054870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 940/1889] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:04.068228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:04.100167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48868c7d-ab43-4528-a492-ec3bf4c44661 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:04.107829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.108545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.109078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.109215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] PATH_INFO: `/v3/projects/e4a9887cc6ca4f748c06cbae8ca6db34/users/517211e7944245c78d771cb1c8baf861/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.110581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 950/1890] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:04.130878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a9887cc6ca4f748c06cbae8ca6db34, user_id=517211e7944245c78d771cb1c8baf861, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.136928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:04.138717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:04.145415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:04.216848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b645f-220c-4abd-9a72-3fe4fcb45290 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:04.220782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2a405-378d-4bea-ad8c-4376a1aebe7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.221580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a405-378d-4bea-ad8c-4376a1aebe7b service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.221935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a405-378d-4bea-ad8c-4376a1aebe7b service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.222285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2a405-378d-4bea-ad8c-4376a1aebe7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.236500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2a405-378d-4bea-ad8c-4376a1aebe7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.241696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2a405-378d-4bea-ad8c-4376a1aebe7b service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:04.250674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 951/1891] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:04.288244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 941/1892] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:04 2022] PUT /identity/v3/projects/e4a9887cc6ca4f748c06cbae8ca6db34/users/517211e7944245c78d771cb1c8baf861/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:04.295516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27066f6-a4ac-4959-9e4f-a6de769f2349 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.296171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27066f6-a4ac-4959-9e4f-a6de769f2349 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.296649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27066f6-a4ac-4959-9e4f-a6de769f2349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.351904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d27066f6-a4ac-4959-9e4f-a6de769f2349 None None] MFA Rules not processed for user `517211e7944245c78d771cb1c8baf861`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:04.354211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d27066f6-a4ac-4959-9e4f-a6de769f2349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:04.417360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:04.432317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:04.435230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 952/1893] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:04.439715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27066f6-a4ac-4959-9e4f-a6de769f2349 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:04.506844 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9a8e7-44da-4a01-9ec8-13ae7465efaf admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:04.516411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.517309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.525840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.525840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.525840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:04.538516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27066f6-a4ac-4959-9e4f-a6de769f2349 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:04.544873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.545593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.545877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.546155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.546808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.548911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:04.611292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.612912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:04.622823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 942/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:04.692102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 953/1895] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:04 2022] POST /identity/v3/projects => generated 387 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:04.692307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:04.700258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ee6c-3bf7-4925-9dc0-72eb72501785 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:04.774532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.775157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.776610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.777066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.777717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.779664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:04.860419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 943/1896] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:04 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:04.864157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:04.876648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade65f1-e8b9-4c7d-b5dc-e578734086b1 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:04.881367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.881975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.882356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.882638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.883430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.885123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:04.898227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 954/1897] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:04.899466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:04.910092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b7fe6-bea0-4046-8c43-e37f87397036 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:04.915234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:04.915828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:04.916708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:04.928466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] PATH_INFO: `/v3/projects/8d9710e09cba436e9f60e771f5ad9c1e/users/2bc885529873433396f52c2e8b9beefc/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:04.933312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9710e09cba436e9f60e771f5ad9c1e, user_id=2bc885529873433396f52c2e8b9beefc, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:04.936038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:05.074754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 944/1898] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:04 2022] PUT /identity/v3/projects/8d9710e09cba436e9f60e771f5ad9c1e/users/2bc885529873433396f52c2e8b9beefc/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:05.077469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:05.093701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d591a-1ffc-4e71-9e65-d96d050d6375 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:05.172026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c251d-f829-495e-876b-6a2620690434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:05.172814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c251d-f829-495e-876b-6a2620690434 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:05.173624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c251d-f829-495e-876b-6a2620690434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:05.173946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c251d-f829-495e-876b-6a2620690434 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:05.174811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c251d-f829-495e-876b-6a2620690434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:05.177101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c251d-f829-495e-876b-6a2620690434 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:05.193766 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 955/1899] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:05.198377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:05.209161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73367db-f982-49c1-90fb-a28565205e5f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:05.216960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:05.217866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:05.218302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:05.218986 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] PATH_INFO: `/v3/projects/8d9710e09cba436e9f60e771f5ad9c1e/users/2bc885529873433396f52c2e8b9beefc/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:05.221766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d9710e09cba436e9f60e771f5ad9c1e, user_id=2bc885529873433396f52c2e8b9beefc, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:05.224668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:05.250882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 945/1900] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:05 2022] PUT /identity/v3/projects/8d9710e09cba436e9f60e771f5ad9c1e/users/2bc885529873433396f52c2e8b9beefc/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:05.261257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d2a2-04a7-4fcd-b195-8a9fa8d4ae0f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:05.261544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d2a2-04a7-4fcd-b195-8a9fa8d4ae0f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:05.261944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3d2a2-04a7-4fcd-b195-8a9fa8d4ae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:05.293734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-35f3d2a2-04a7-4fcd-b195-8a9fa8d4ae0f None None] MFA Rules not processed for user `2bc885529873433396f52c2e8b9beefc`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:05.294970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-35f3d2a2-04a7-4fcd-b195-8a9fa8d4ae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:05.402367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 956/1901] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:05.412814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:05.483234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb09a8b-31d9-4812-ab5c-2e04f4dbb5ac admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:05.486965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11265d7d-0a72-477e-b82b-d4163d196273 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:05.487694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11265d7d-0a72-477e-b82b-d4163d196273 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:05.488054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11265d7d-0a72-477e-b82b-d4163d196273 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:05.488437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11265d7d-0a72-477e-b82b-d4163d196273 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:05.502313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11265d7d-0a72-477e-b82b-d4163d196273 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:05.505580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11265d7d-0a72-477e-b82b-d4163d196273 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:05.516308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 946/1902] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:05.647646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:06.020483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d2a2-04a7-4fcd-b195-8a9fa8d4ae0f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:06.030200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:06.089729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3d2a2-04a7-4fcd-b195-8a9fa8d4ae0f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:06.095718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:06.096633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:06.097524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:06.111966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] PATH_INFO: `/v3/users/517211e7944245c78d771cb1c8baf861` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:06.113387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517211e7944245c78d771cb1c8baf861)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:06.133799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:06.352048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517211e7944245c78d771cb1c8baf861'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:06.352954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517211e7944245c78d771cb1c8baf861'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:06.354196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517211e7944245c78d771cb1c8baf861'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:06.370380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517211e7944245c78d771cb1c8baf861'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:06.443215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517211e7944245c78d771cb1c8baf861'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:06.457655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 957/1903] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:06 2022] DELETE /identity/v3/users/517211e7944245c78d771cb1c8baf861 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:06.462196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:06.463155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:06.463336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:06.483809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:06.485096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:06.559342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 947/1904] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:06.573102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:06.574490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:06.655057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f523f-bcbe-4174-8b23-59571cfb5f84 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:06.661722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681b450-957a-40c0-955b-648054225167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:06.661722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681b450-957a-40c0-955b-648054225167 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:06.661722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681b450-957a-40c0-955b-648054225167 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:06.661722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681b450-957a-40c0-955b-648054225167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:06.670304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681b450-957a-40c0-955b-648054225167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:06.671883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681b450-957a-40c0-955b-648054225167 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:06.681823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 958/1905] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:06.960564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:07.321135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:07.325437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:07.340339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8a185-4c28-45c0-8e27-daf6b510cee3 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:07.348835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:07.349575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:07.349856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:07.350132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] PATH_INFO: `/v3/projects/e4a9887cc6ca4f748c06cbae8ca6db34` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:07.352856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a9887cc6ca4f748c06cbae8ca6db34)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:07.355293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:07.474595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a9887cc6ca4f748c06cbae8ca6db34', 'request_id': 'req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.481440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a9887cc6ca4f748c06cbae8ca6db34', 'request_id': 'req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.488065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a9887cc6ca4f748c06cbae8ca6db34', 'request_id': 'req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.593854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] The token cache is being invalidate because project e4a9887cc6ca4f748c06cbae8ca6db34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:07.594156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.594795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.596357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 948/1906] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:07 2022] DELETE /identity/v3/projects/e4a9887cc6ca4f748c06cbae8ca6db34 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:07.600485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681b450-957a-40c0-955b-648054225167 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:07.610902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681b450-957a-40c0-955b-648054225167 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:07.690846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:07.694377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:07.694377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:07.694377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] PATH_INFO: `/v3/users/2bc885529873433396f52c2e8b9beefc` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:07.694377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc885529873433396f52c2e8b9beefc)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:07.695569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:07.831666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:07.833382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:07.846793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e987d8-0d0d-4b91-b1ce-8347a4ade356 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:07.851495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:07.858624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:07.858624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:07.858624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] PATH_INFO: `/v3/users/44d07ce7c99d4cac8d8638dfdb09cc9d` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:07.858624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d07ce7c99d4cac8d8638dfdb09cc9d)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:07.858624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:07.887867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc885529873433396f52c2e8b9beefc'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.888539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc885529873433396f52c2e8b9beefc'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.889160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc885529873433396f52c2e8b9beefc'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.901331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc885529873433396f52c2e8b9beefc'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.954267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc885529873433396f52c2e8b9beefc'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:07.967531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 959/1907] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:07 2022] DELETE /identity/v3/users/2bc885529873433396f52c2e8b9beefc => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:07.969010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:07.970392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:08.041534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dc318-c37f-442a-8b1a-7e972cc998a0 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:08.047057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:08.047713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:08.048411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:08.048532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] PATH_INFO: `/v3/users/284e4b0159974c9e851159368d5105fe` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:08.049667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=284e4b0159974c9e851159368d5105fe)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:08.051767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:08.062680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d07ce7c99d4cac8d8638dfdb09cc9d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.063267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d07ce7c99d4cac8d8638dfdb09cc9d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.063892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d07ce7c99d4cac8d8638dfdb09cc9d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.071628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d07ce7c99d4cac8d8638dfdb09cc9d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.162646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3eb81372-a268-4a01-ad36-0971271cf46b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d07ce7c99d4cac8d8638dfdb09cc9d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.183329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:08.185331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 949/1908] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:07 2022] DELETE /identity/v3/users/44d07ce7c99d4cac8d8638dfdb09cc9d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:08.189974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:08.191335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:08.191869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:08.214578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:08.215852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:08.229634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '284e4b0159974c9e851159368d5105fe'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.230593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '284e4b0159974c9e851159368d5105fe'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.231231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '284e4b0159974c9e851159368d5105fe'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.250630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '284e4b0159974c9e851159368d5105fe'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.311653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 950/1909] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:08.321495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-69319d62-3e60-4fff-8d73-666fcb782e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '284e4b0159974c9e851159368d5105fe'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:08.332483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:08.337715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:08.346499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 960/1910] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:07 2022] DELETE /identity/v3/users/284e4b0159974c9e851159368d5105fe => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:08.351376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d20f-3b50-4618-b32e-beea2ac92a78 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:08.352258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d20f-3b50-4618-b32e-beea2ac92a78 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:08.354322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d20f-3b50-4618-b32e-beea2ac92a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:08.399989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-bca1d20f-3b50-4618-b32e-beea2ac92a78 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:08.402555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-bca1d20f-3b50-4618-b32e-beea2ac92a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:08.453826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0c4ac-7cd3-4c91-812e-c86f8bec1dbf None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:08.480874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 961/1911] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:08.491184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d20f-3b50-4618-b32e-beea2ac92a78 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:08.529848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:08.530478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:08.530963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:08.531242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:08.541836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:08.543295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:08.555395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 951/1912] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:08.569328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d20f-3b50-4618-b32e-beea2ac92a78 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:08.574310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb46678-3878-4f6d-9aad-afaa5d8ca39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:08.574936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46678-3878-4f6d-9aad-afaa5d8ca39e service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:08.575668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46678-3878-4f6d-9aad-afaa5d8ca39e service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:08.575668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb46678-3878-4f6d-9aad-afaa5d8ca39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:08.586775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb46678-3878-4f6d-9aad-afaa5d8ca39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:08.588325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb46678-3878-4f6d-9aad-afaa5d8ca39e service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:08.599595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 962/1913] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:08.603072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:08.847502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:08.849494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:08.883080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b468aa2-0275-4963-9df7-e19547e6a072 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:08.888273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:08.888953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:08.889230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:08.889729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] PATH_INFO: `/v3/projects/8d9710e09cba436e9f60e771f5ad9c1e` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:08.890922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d9710e09cba436e9f60e771f5ad9c1e)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:08.892926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:09.014768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:09.021264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d9710e09cba436e9f60e771f5ad9c1e', 'request_id': 'req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.027485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d9710e09cba436e9f60e771f5ad9c1e', 'request_id': 'req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.033335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d9710e09cba436e9f60e771f5ad9c1e', 'request_id': 'req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.140619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] The token cache is being invalidate because project 8d9710e09cba436e9f60e771f5ad9c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:09.141151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.145226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-0cf2b04a-54b4-49d0-9d96-7f75d3cd97a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.145226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 952/1914] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:08 2022] DELETE /identity/v3/projects/8d9710e09cba436e9f60e771f5ad9c1e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:09.149227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aeb1e-e8f8-4c2d-89a6-eae8ec15a81b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.149518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aeb1e-e8f8-4c2d-89a6-eae8ec15a81b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.149798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6aeb1e-e8f8-4c2d-89a6-eae8ec15a81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.174032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2c6aeb1e-e8f8-4c2d-89a6-eae8ec15a81b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:09.175841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2c6aeb1e-e8f8-4c2d-89a6-eae8ec15a81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:09.242239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 963/1915] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:09.250711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63dbc-bd4e-40f6-aa50-6d2d57ee37b7 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.251288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63dbc-bd4e-40f6-aa50-6d2d57ee37b7 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.251748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d63dbc-bd4e-40f6-aa50-6d2d57ee37b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.274485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b3d63dbc-bd4e-40f6-aa50-6d2d57ee37b7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:09.276306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b3d63dbc-bd4e-40f6-aa50-6d2d57ee37b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:09.287536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 953/1916] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:09.297289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aeb1e-e8f8-4c2d-89a6-eae8ec15a81b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:09.309279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6aeb1e-e8f8-4c2d-89a6-eae8ec15a81b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:09.314063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:09.314672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.314953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.315230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.315887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:09.316219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:09.317825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:09.329360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 964/1917] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:09.334068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63dbc-bd4e-40f6-aa50-6d2d57ee37b7 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:09.343898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d63dbc-bd4e-40f6-aa50-6d2d57ee37b7 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:09.355663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:09.357715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:09.358981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.359272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.359548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.359857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:09.360375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:09.362864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:09.394646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2945ce-8bd4-44c9-b0f2-9f28ed54bb13 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:09.411921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:09.412707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.413129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.413414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] PATH_INFO: `/v3/projects/2d6db33ffbac4f078a419420b6e824f0` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.414673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6db33ffbac4f078a419420b6e824f0)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:09.417936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:09.517447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 954/1918] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:09 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:09.520807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:09.524548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:09.556242 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6db33ffbac4f078a419420b6e824f0', 'request_id': 'req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.561920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6db33ffbac4f078a419420b6e824f0', 'request_id': 'req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.607296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec35fdd-0d4e-4ef9-99e3-0831bb7c5e36 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:09.648464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6db33ffbac4f078a419420b6e824f0', 'request_id': 'req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.661104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] The token cache is being invalidate because project 2d6db33ffbac4f078a419420b6e824f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:09.661386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.662094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.663998 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 965/1919] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:09 2022] DELETE /identity/v3/projects/2d6db33ffbac4f078a419420b6e824f0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:09.664803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:09.666685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:09.680968 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:09.682656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.683130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.683430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] PATH_INFO: `/v3/projects/b16422d775e54cc790f3f183d435189a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.683543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1859-67e9-40ff-9d4d-f3bb11a0ecbf admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:09.685074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16422d775e54cc790f3f183d435189a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:09.687098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:09.688607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:09.689195 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.691897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.691897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.691897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:09.692307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:09.807171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 966/1920] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:09 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:09.807171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:09.809468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:09.821735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1421f3a-54c7-458e-9f6b-22c80b18fe64 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:09.827545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:09.828183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:09.828606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:09.828890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] PATH_INFO: `/v3/users/4e96a2ed69cd4402b1973567cd664bf5` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:09.830058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e96a2ed69cd4402b1973567cd664bf5)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:09.832284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:09.846492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16422d775e54cc790f3f183d435189a', 'request_id': 'req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.853024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16422d775e54cc790f3f183d435189a', 'request_id': 'req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.859683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16422d775e54cc790f3f183d435189a', 'request_id': 'req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.977607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] The token cache is being invalidate because project b16422d775e54cc790f3f183d435189a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:09.977820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.979021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:09.980951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 955/1921] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:09 2022] DELETE /identity/v3/projects/b16422d775e54cc790f3f183d435189a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:09.981920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:09.983245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:10.046292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e96a2ed69cd4402b1973567cd664bf5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.049660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e96a2ed69cd4402b1973567cd664bf5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.049660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e96a2ed69cd4402b1973567cd664bf5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.063202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e96a2ed69cd4402b1973567cd664bf5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.069115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cff0f-c0b0-4b79-9627-d543ca7cc779 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:10.074221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:10.074842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:10.075124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:10.076028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:10.076243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:10.078242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:10.092933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 956/1922] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:10.094090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:10.095953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:10.109679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dbc27-9e88-4a36-bb7e-c00450a55344 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:10.114785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:10.115635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:10.116082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:10.116405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] PATH_INFO: `/v3/users/334ef239a5874b54911f46596c560bd0` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:10.117593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=334ef239a5874b54911f46596c560bd0)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:10.119641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:10.154226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e96a2ed69cd4402b1973567cd664bf5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.174566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 967/1923] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:09 2022] DELETE /identity/v3/users/4e96a2ed69cd4402b1973567cd664bf5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:10.175595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:10.177639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:10.275724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f207954d-ceaa-4516-bb06-5f30abd97368 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:10.281113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:10.281851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:10.282281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:10.282537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:10.284230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:10.288264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:10.364492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334ef239a5874b54911f46596c560bd0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.364492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334ef239a5874b54911f46596c560bd0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.364492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334ef239a5874b54911f46596c560bd0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.365368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 968/1924] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:10.365368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:10.365368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:10.365640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334ef239a5874b54911f46596c560bd0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.365733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5535a81-f86b-4047-b3e2-81f4072b6b01 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:10.365733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:10.365733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:10.365733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:10.366073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] PATH_INFO: `/v3/projects/a2f070e312d34a4588363283796fa298/users/94f93c5f17974c47beb1f62059047370/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:10.366073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f070e312d34a4588363283796fa298, user_id=94f93c5f17974c47beb1f62059047370, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:10.366073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:10.454962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-01960821-c1ee-4480-a632-8f71d33a49e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334ef239a5874b54911f46596c560bd0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:10.476837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 957/1925] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:10 2022] DELETE /identity/v3/users/334ef239a5874b54911f46596c560bd0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:10.514398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 969/1926] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:10 2022] PUT /identity/v3/projects/a2f070e312d34a4588363283796fa298/users/94f93c5f17974c47beb1f62059047370/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:10.525071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:10.526611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:10.527415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:10.562287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] MFA Rules not processed for user `94f93c5f17974c47beb1f62059047370`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:10.563730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:10.622194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:10.646578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 958/1927] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:10.658628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:10.661063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:10.735153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:10.737044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:10.768720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:10.784852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ad9d6-b9e7-45ec-9e9a-3b68d631475b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:10.789514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:10.790254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:10.790649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:10.791009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:10.804166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:10.808022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:10.828661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 970/1928] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:10.863395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aac7fa-7768-4553-b024-6b1c92b44870 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:10.869557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:10.871202 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:10.871495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:10.872793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] PATH_INFO: `/v3/projects/1b9544f2596747a6969f994c08c37102` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:10.874086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9544f2596747a6969f994c08c37102)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:10.876627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:11.073788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9544f2596747a6969f994c08c37102', 'request_id': 'req-78009662-3583-4b26-9b41-4ab76c53d7ee'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.080686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9544f2596747a6969f994c08c37102', 'request_id': 'req-78009662-3583-4b26-9b41-4ab76c53d7ee'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.090135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:11.092851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:11.106691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9544f2596747a6969f994c08c37102', 'request_id': 'req-78009662-3583-4b26-9b41-4ab76c53d7ee'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.111059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bdd0b-906d-4fe2-961b-2533a1dc9d1a service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:11.176496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:11.177144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:11.177422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:11.177704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] PATH_INFO: `/v3/projects/a6b8dd651f504280b4576120f26f7f6c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:11.178866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b8dd651f504280b4576120f26f7f6c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:11.180857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:11.210014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] The token cache is being invalidate because project 1b9544f2596747a6969f994c08c37102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:11.210014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.210742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.215501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 959/1929] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:10 2022] DELETE /identity/v3/projects/1b9544f2596747a6969f994c08c37102 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:11.216733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:11.218230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:11.236953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78009662-3583-4b26-9b41-4ab76c53d7ee admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:11.240341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:11.240993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:11.241282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:11.241556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] PATH_INFO: `/v3/users/140d9fcd74b94c32b3af1a16d55c7a4a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:11.242771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140d9fcd74b94c32b3af1a16d55c7a4a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:11.245478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:11.313099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b8dd651f504280b4576120f26f7f6c', 'request_id': 'req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.319738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b8dd651f504280b4576120f26f7f6c', 'request_id': 'req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.393393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b8dd651f504280b4576120f26f7f6c', 'request_id': 'req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.416626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] The token cache is being invalidate because project a6b8dd651f504280b4576120f26f7f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:11.417266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.419122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0bfc1c8d-699d-463b-af49-0bdd4a78b44f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.421839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 971/1930] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:11 2022] DELETE /identity/v3/projects/a6b8dd651f504280b4576120f26f7f6c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:11.438393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06d84-f5eb-41eb-a612-5cdbbfec3bd1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:11.440080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06d84-f5eb-41eb-a612-5cdbbfec3bd1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:11.440080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c06d84-f5eb-41eb-a612-5cdbbfec3bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:11.463267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-67c06d84-f5eb-41eb-a612-5cdbbfec3bd1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:11.465473 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-67c06d84-f5eb-41eb-a612-5cdbbfec3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:11.480597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140d9fcd74b94c32b3af1a16d55c7a4a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.481305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140d9fcd74b94c32b3af1a16d55c7a4a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.482305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140d9fcd74b94c32b3af1a16d55c7a4a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.497387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140d9fcd74b94c32b3af1a16d55c7a4a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.536979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 972/1931] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:11.552724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab476593-8c7d-43e9-b87a-552adf09da6f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:11.552724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab476593-8c7d-43e9-b87a-552adf09da6f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:11.552724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab476593-8c7d-43e9-b87a-552adf09da6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:11.576860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ab476593-8c7d-43e9-b87a-552adf09da6f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:11.581501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ab476593-8c7d-43e9-b87a-552adf09da6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:11.588245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 973/1932] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:11.591703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab476593-8c7d-43e9-b87a-552adf09da6f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:11.604759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140d9fcd74b94c32b3af1a16d55c7a4a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:11.608169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab476593-8c7d-43e9-b87a-552adf09da6f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:11.616100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:11.616806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:11.617094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:11.617375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:11.618045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:11.618356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:11.620011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:11.628984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 960/1933] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:11 2022] DELETE /identity/v3/users/140d9fcd74b94c32b3af1a16d55c7a4a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:11.651508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 974/1934] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:51:11.654107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:11.730844 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373843a7-a2b6-4d47-a0a2-7d63aa2d43a6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:11.735941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:11.736607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:11.736922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:11.737205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:11.737877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:11.739799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:11.871807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 961/1935] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:11 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:11.876150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:11.888844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b943e73a-f258-4737-8282-35b9242c7145 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:11.949920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:11.950564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:11.950846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:11.951124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:11.951755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:11.953719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.044240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 975/1936] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:11 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:12.048171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.065657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6105089-513e-45c9-87d0-3b9043336a70 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.071306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.072415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.072809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.073206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.074216 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.075526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.088970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 962/1937] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:12.093807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.104559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145584e0-6210-4d3a-8c0c-e28eba4bfab8 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.109750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.110361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.110643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.110918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.111627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.113338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.124338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 976/1938] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:12.130183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.140957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4391547-739a-4770-bd1e-10e5f7b50b71 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.145819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7779ec-d571-4e70-bf93-4209d9a54279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.146765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7779ec-d571-4e70-bf93-4209d9a54279 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.147057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7779ec-d571-4e70-bf93-4209d9a54279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.147348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7779ec-d571-4e70-bf93-4209d9a54279 admin admin] PATH_INFO: `/v3/projects/9a2e448dd60e41328ca835aa363f011f/users/ef6362fef756465b8127a9836af4e56d/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.163880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7779ec-d571-4e70-bf93-4209d9a54279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a2e448dd60e41328ca835aa363f011f, user_id=ef6362fef756465b8127a9836af4e56d, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.166631 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7779ec-d571-4e70-bf93-4209d9a54279 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.185588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.187330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:12.200975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bc238-221b-4504-8906-0c1c4ad66e2a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.206234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.207037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.207330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.207885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] PATH_INFO: `/v3/projects/a42d4dbb17c04b6cabec87c1a1ee0d26` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.209268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42d4dbb17c04b6cabec87c1a1ee0d26)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.213576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.255031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:12.262404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 963/1939] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:12 2022] PUT /identity/v3/projects/9a2e448dd60e41328ca835aa363f011f/users/ef6362fef756465b8127a9836af4e56d/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:12.273035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af098-4025-401d-87d0-97be1a95315d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.273399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af098-4025-401d-87d0-97be1a95315d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.273688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af098-4025-401d-87d0-97be1a95315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.300990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42d4dbb17c04b6cabec87c1a1ee0d26', 'request_id': 'req-fd01b441-da2c-4638-a53b-ba29006baef6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:12.304908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-834af098-4025-401d-87d0-97be1a95315d None None] MFA Rules not processed for user `ef6362fef756465b8127a9836af4e56d`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:12.306652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-834af098-4025-401d-87d0-97be1a95315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:12.308077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42d4dbb17c04b6cabec87c1a1ee0d26', 'request_id': 'req-fd01b441-da2c-4638-a53b-ba29006baef6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:12.311016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:12.370964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 964/1940] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:12.375868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834af098-4025-401d-87d0-97be1a95315d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.417343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42d4dbb17c04b6cabec87c1a1ee0d26', 'request_id': 'req-fd01b441-da2c-4638-a53b-ba29006baef6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:12.428475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] The token cache is being invalidate because project a42d4dbb17c04b6cabec87c1a1ee0d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:12.429010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:12.429731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fd01b441-da2c-4638-a53b-ba29006baef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:12.432043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 977/1941] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:12 2022] DELETE /identity/v3/projects/a42d4dbb17c04b6cabec87c1a1ee0d26 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:12.437669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d585-8905-4f6a-980d-d6faf6a19691 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.437959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d585-8905-4f6a-980d-d6faf6a19691 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.438377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93d585-8905-4f6a-980d-d6faf6a19691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.438482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834af098-4025-401d-87d0-97be1a95315d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.445645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.446313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.446576 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.447764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.449265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.451205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.459941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-eb93d585-8905-4f6a-980d-d6faf6a19691 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:12.461290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-eb93d585-8905-4f6a-980d-d6faf6a19691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:12.472678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 978/1942] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:12.481074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2621cc9-96e8-46f6-8aa1-5f379582aff6 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.481365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2621cc9-96e8-46f6-8aa1-5f379582aff6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.481652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2621cc9-96e8-46f6-8aa1-5f379582aff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.516439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f2621cc9-96e8-46f6-8aa1-5f379582aff6 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:12.525921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f2621cc9-96e8-46f6-8aa1-5f379582aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:12.545170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 979/1943] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:12.546093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2621cc9-96e8-46f6-8aa1-5f379582aff6 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.555970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2621cc9-96e8-46f6-8aa1-5f379582aff6 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.565524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 965/1944] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:12 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:12.568805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.568805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.569134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.569317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.569984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:12.570289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.571863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.572141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.577322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:12.588373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 980/1945] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:12.590602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.604628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb0581-a98f-43d5-be36-eaadb3859d36 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.676524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49f3b6-7cd8-4140-bb15-44299e5ec740 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.676524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.676524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.676524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.677189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.677189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.677189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.694355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.694711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.695005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.695286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.695940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.698179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.756225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 966/1946] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:12 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:12.758418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.768712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9656-40bb-4e78-a42e-4c8dbfb4f17d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.773645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.774281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.774568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.774892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.775561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.777231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.790128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 967/1947] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:12.796122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 981/1948] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:12 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:12.796280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.797307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:12.806729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f5224-048e-41d8-bf27-1137632e6cf3 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.870592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.871235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.871377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d53ee-05a2-4ac2-b30f-6febbd235031 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:12.871529 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.871864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.872583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.874851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:12.878727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:12.879566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:12.880339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:12.880827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] PATH_INFO: `/v3/projects/98993b80e0584e02b858dec8b4dbfe2a/users/b434004787dc41ea991fa01de096c9f2/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:12.897277 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98993b80e0584e02b858dec8b4dbfe2a, user_id=b434004787dc41ea991fa01de096c9f2, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:12.900665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.005155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 982/1949] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:12 2022] PUT /identity/v3/projects/98993b80e0584e02b858dec8b4dbfe2a/users/b434004787dc41ea991fa01de096c9f2/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:13.005332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 968/1950] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:12 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:13.005429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:13.007389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:13.019198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11df3d3-0699-4484-ad8c-e2983c9394ea admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:13.075010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbc971-1720-45b8-87db-4a6a1dc767a8 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:13.080851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:13.081511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.081798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.082218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.082728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:13.084397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.085773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:13.088580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.088580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.088580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.088580 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:13.090364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.099963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 983/1951] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:13.101282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:13.106772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 969/1952] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:13.113999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c685b0-abb4-42a8-a185-b57fdef84766 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:13.115003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:13.126955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba59e0-d571-4d25-ae9b-0f15ec9fd6c8 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:13.131251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:13.132143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.132294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.132566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.133238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:13.136511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.145944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8402b48-83b2-4fc9-bac4-987871e1f16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:13.146984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8402b48-83b2-4fc9-bac4-987871e1f16f admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.147487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8402b48-83b2-4fc9-bac4-987871e1f16f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.153123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 984/1953] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:13.153123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:13.154352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8402b48-83b2-4fc9-bac4-987871e1f16f admin admin] PATH_INFO: `/v3/projects/98993b80e0584e02b858dec8b4dbfe2a/users/b434004787dc41ea991fa01de096c9f2/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.158774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8402b48-83b2-4fc9-bac4-987871e1f16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98993b80e0584e02b858dec8b4dbfe2a, user_id=b434004787dc41ea991fa01de096c9f2, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:13.162558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8402b48-83b2-4fc9-bac4-987871e1f16f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.173353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034b3e2-dfc1-4f45-bb90-60e14d71633d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:13.181188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 970/1954] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:13 2022] PUT /identity/v3/projects/98993b80e0584e02b858dec8b4dbfe2a/users/b434004787dc41ea991fa01de096c9f2/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:13.193106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.193654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.194147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.229278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] MFA Rules not processed for user `b434004787dc41ea991fa01de096c9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:13.230517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:13.249913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d08640-2639-4ad1-ae78-c2bd1d945f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:13.250273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08640-2639-4ad1-ae78-c2bd1d945f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.250560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08640-2639-4ad1-ae78-c2bd1d945f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.251232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d08640-2639-4ad1-ae78-c2bd1d945f22 admin admin] PATH_INFO: `/v3/projects/bd4d04a282bc4f2189600eae22f1ebd0/users/339c97ab2cd24834a5b3f1fd4ad5b475/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.273478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d08640-2639-4ad1-ae78-c2bd1d945f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4d04a282bc4f2189600eae22f1ebd0, user_id=339c97ab2cd24834a5b3f1fd4ad5b475, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:13.277101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d08640-2639-4ad1-ae78-c2bd1d945f22 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.344795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 971/1955] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:13.355707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:13.357186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:13.391236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 985/1956] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:13 2022] PUT /identity/v3/projects/bd4d04a282bc4f2189600eae22f1ebd0/users/339c97ab2cd24834a5b3f1fd4ad5b475/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:13.393813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.394304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.394659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.438788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] MFA Rules not processed for user `339c97ab2cd24834a5b3f1fd4ad5b475`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:13.440119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:13.464811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d7266c-acb7-464b-ba31-1b8cd834f295 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:13.515370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 986/1957] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:13.523559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:13.524834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:13.532624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:13.533252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.534277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.534554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.590604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696161e-ca79-4b8d-aab4-e45b78ddf899 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:13.595377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a3a4c-1f9a-42bb-bc98-99b7191cd58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:13.595929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3a4c-1f9a-42bb-bc98-99b7191cd58a service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:13.596231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3a4c-1f9a-42bb-bc98-99b7191cd58a service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:13.596513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a3a4c-1f9a-42bb-bc98-99b7191cd58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:13.604044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:13.605572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.612955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a3a4c-1f9a-42bb-bc98-99b7191cd58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:13.615234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a3a4c-1f9a-42bb-bc98-99b7191cd58a service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:13.629784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 972/1958] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:13.643874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 987/1959] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:13.743032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:14.531664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:15.168566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:15.229732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb37cc7-5cd3-4c0c-8510-b24ea5df0cfa service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:15.234395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:15.235033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:15.235316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:15.235596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] PATH_INFO: `/v3/users/ef6362fef756465b8127a9836af4e56d` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:15.236775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6362fef756465b8127a9836af4e56d)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:15.238691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:15.430739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6362fef756465b8127a9836af4e56d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:15.431897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6362fef756465b8127a9836af4e56d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:15.432489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6362fef756465b8127a9836af4e56d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:15.437203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:15.439792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6362fef756465b8127a9836af4e56d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:15.488369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6362fef756465b8127a9836af4e56d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:15.507056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 973/1960] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:15 2022] DELETE /identity/v3/users/ef6362fef756465b8127a9836af4e56d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:15.512223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:15.516535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:15.516535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:15.532167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:15.533441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:15.592910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 988/1961] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:15.602692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:15.604662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:15.663458 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811b23af-e826-4bf3-b5ea-70b65eba5ed2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:15.667717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:15.668408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:15.668697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:15.668980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:15.680736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:15.682939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:15.692762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 974/1962] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:16.180946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:16.183101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:16.196257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f24e60-4499-4da0-a25b-16a7efbd370d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:16.208475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:16.208475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:16.208475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:16.208475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] PATH_INFO: `/v3/projects/9a2e448dd60e41328ca835aa363f011f` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:16.209191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a2e448dd60e41328ca835aa363f011f)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:16.209191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:16.333171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a2e448dd60e41328ca835aa363f011f', 'request_id': 'req-c0941fa7-2d87-44f5-94d8-0384c39359fb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.340495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a2e448dd60e41328ca835aa363f011f', 'request_id': 'req-c0941fa7-2d87-44f5-94d8-0384c39359fb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.468107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a2e448dd60e41328ca835aa363f011f', 'request_id': 'req-c0941fa7-2d87-44f5-94d8-0384c39359fb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.480165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] The token cache is being invalidate because project 9a2e448dd60e41328ca835aa363f011f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:16.480491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.481156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.482747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 989/1963] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:16 2022] DELETE /identity/v3/projects/9a2e448dd60e41328ca835aa363f011f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:16.486777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:16.496666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dc76a-c0c1-4def-a82c-e8e1a6d1e6e7 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:16.558892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:16.558892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:16.559166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:16.559245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] PATH_INFO: `/v3/users/b434004787dc41ea991fa01de096c9f2` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:16.564945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b434004787dc41ea991fa01de096c9f2)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:16.567062 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:16.784329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b434004787dc41ea991fa01de096c9f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.784993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b434004787dc41ea991fa01de096c9f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.785643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b434004787dc41ea991fa01de096c9f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.793342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b434004787dc41ea991fa01de096c9f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.862208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ef12492e-d70c-47f5-8097-c41b9d8503c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b434004787dc41ea991fa01de096c9f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:16.881183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 975/1964] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:16 2022] DELETE /identity/v3/users/b434004787dc41ea991fa01de096c9f2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:17.091119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:17.287042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:17.288622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:17.309726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0941fa7-2d87-44f5-94d8-0384c39359fb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:17.362789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:17.363426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:17.363708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:17.363985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] PATH_INFO: `/v3/projects/98993b80e0584e02b858dec8b4dbfe2a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:17.365133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98993b80e0584e02b858dec8b4dbfe2a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:17.367058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:17.519749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98993b80e0584e02b858dec8b4dbfe2a', 'request_id': 'req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:17.525806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98993b80e0584e02b858dec8b4dbfe2a', 'request_id': 'req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:17.614046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98993b80e0584e02b858dec8b4dbfe2a', 'request_id': 'req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:17.628239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] The token cache is being invalidate because project 98993b80e0584e02b858dec8b4dbfe2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:17.628239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:17.632754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-78b1357a-e3e7-4ca5-a8a8-d650e23a7006 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:17.635475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 990/1965] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:17 2022] DELETE /identity/v3/projects/98993b80e0584e02b858dec8b4dbfe2a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:17.640098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaa8d4-76c9-49b6-90e2-2489b9283531 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:17.646801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaa8d4-76c9-49b6-90e2-2489b9283531 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:17.646801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaa8d4-76c9-49b6-90e2-2489b9283531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:17.665492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d6aaa8d4-76c9-49b6-90e2-2489b9283531 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:17.665492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d6aaa8d4-76c9-49b6-90e2-2489b9283531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:17.727220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 976/1966] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:17.735233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d4d6-d072-417b-ad88-c3d1357fbcff None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:17.738430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d4d6-d072-417b-ad88-c3d1357fbcff None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:17.738430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8d4d6-d072-417b-ad88-c3d1357fbcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:17.756211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a8b8d4d6-d072-417b-ad88-c3d1357fbcff None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:17.757443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a8b8d4d6-d072-417b-ad88-c3d1357fbcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:17.766007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 991/1967] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:17.770315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaa8d4-76c9-49b6-90e2-2489b9283531 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:17.783936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaa8d4-76c9-49b6-90e2-2489b9283531 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:17.785733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:17.786744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:17.786744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:17.787119 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:17.787848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:17.788289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:17.790832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:17.804341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 977/1968] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:51:17.809971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d4d6-d072-417b-ad88-c3d1357fbcff None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:17.820008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8d4d6-d072-417b-ad88-c3d1357fbcff None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:17.825444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:17.826356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:17.826841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:17.827184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:17.827891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:17.831327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:17.859312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:18.002750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 992/1969] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:17 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:18.006752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:18.018988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfce25-332f-4b73-9061-dfd19935523d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:18.083494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:18.084224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.084531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.084809 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.085445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:18.087439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:18.167154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 978/1970] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:18 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:18.171269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:18.182757 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9383-45e7-4a61-b040-e60d66c09fc3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:18.188384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:18.192610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.192610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.192610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.192610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:18.192610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:18.202952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 993/1971] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:18.207366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:18.218397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e2eef-e587-47cc-8ca3-3fdc6d568f82 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:18.223206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8c3f6-d7ba-4d2a-aa7a-272aeb31d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:18.223844 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c3f6-d7ba-4d2a-aa7a-272aeb31d4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.224125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c3f6-d7ba-4d2a-aa7a-272aeb31d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.224429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8c3f6-d7ba-4d2a-aa7a-272aeb31d4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.225076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c3f6-d7ba-4d2a-aa7a-272aeb31d4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:18.226669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8c3f6-d7ba-4d2a-aa7a-272aeb31d4b3 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:18.238145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 979/1972] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:18.242868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:18.252924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f154554-38ef-4a2c-88e8-95b5db9c23d6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:18.257805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:18.258465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.258753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.259046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] PATH_INFO: `/v3/projects/b164915c38d747c3b19db49cfccf3c69/users/c689419ec78740f8b2ff9761b9051a87/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.276284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b164915c38d747c3b19db49cfccf3c69, user_id=c689419ec78740f8b2ff9761b9051a87, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:18.280076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:18.440745 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 994/1973] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:18 2022] PUT /identity/v3/projects/b164915c38d747c3b19db49cfccf3c69/users/c689419ec78740f8b2ff9761b9051a87/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:18.451720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2980af-b87f-42b8-8d22-d067015730e2 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.452017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2980af-b87f-42b8-8d22-d067015730e2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.452387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2980af-b87f-42b8-8d22-d067015730e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.485898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5e2980af-b87f-42b8-8d22-d067015730e2 None None] MFA Rules not processed for user `c689419ec78740f8b2ff9761b9051a87`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:18.487276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5e2980af-b87f-42b8-8d22-d067015730e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:18.567747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 980/1974] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:18.568927 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:18.643953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5fb63-a971-4e33-9f56-d21830371bc5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:18.649217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:18.650406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.650685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.650957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.651607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:18.653792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:18.744527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 995/1975] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:18 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:18.748434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2980af-b87f-42b8-8d22-d067015730e2 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:18.759756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2980af-b87f-42b8-8d22-d067015730e2 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:18.817569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:18.818233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.818451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.818727 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.819351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:18.821978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:18.971309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 981/1976] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:18 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:18.972648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:18.982507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5099b9-d42d-438a-8f79-6138cdfe6761 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:18.987367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:18.988082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:18.988336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:18.988832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:18.989251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:18.990852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:19.001738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 996/1977] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:19.006048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:19.017636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecf07-c05f-442c-bf2d-542b1e17e7d6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:19.022169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:19.022837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:19.023151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:19.023430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] PATH_INFO: `/v3/projects/e78bf6d693894c96b17169fd7b23d437/users/b22d0e7a9ca74a18a2ec1ff5432c13c9/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:19.041408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78bf6d693894c96b17169fd7b23d437, user_id=b22d0e7a9ca74a18a2ec1ff5432c13c9, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:19.041408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:19.124206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 982/1978] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:19 2022] PUT /identity/v3/projects/e78bf6d693894c96b17169fd7b23d437/users/b22d0e7a9ca74a18a2ec1ff5432c13c9/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:19.125289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:19.136546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efa0ca-da12-4c59-88cd-4780546bbfba admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:19.241555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b6e61-a17c-4ab0-ab8a-c5b4531d0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:19.242188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6e61-a17c-4ab0-ab8a-c5b4531d0dfa admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:19.242626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6e61-a17c-4ab0-ab8a-c5b4531d0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:19.243761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b6e61-a17c-4ab0-ab8a-c5b4531d0dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:19.244260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b6e61-a17c-4ab0-ab8a-c5b4531d0dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:19.247516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b6e61-a17c-4ab0-ab8a-c5b4531d0dfa admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:19.259512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 997/1979] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:19.263574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:19.274620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ea1be-e07a-4d9c-9312-a72419f34676 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:19.280188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:19.283678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:19.291098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:19.292135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:19.292135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] PATH_INFO: `/v3/projects/e78bf6d693894c96b17169fd7b23d437/users/b22d0e7a9ca74a18a2ec1ff5432c13c9/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:19.301215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e78bf6d693894c96b17169fd7b23d437, user_id=b22d0e7a9ca74a18a2ec1ff5432c13c9, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:19.303581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:19.329741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 983/1980] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:19 2022] PUT /identity/v3/projects/e78bf6d693894c96b17169fd7b23d437/users/b22d0e7a9ca74a18a2ec1ff5432c13c9/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:19.335143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c4fa-8b95-4903-b24d-4a168dac5763 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:19.335462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c4fa-8b95-4903-b24d-4a168dac5763 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:19.335857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c4fa-8b95-4903-b24d-4a168dac5763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:19.367315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e919c4fa-8b95-4903-b24d-4a168dac5763 None None] MFA Rules not processed for user `b22d0e7a9ca74a18a2ec1ff5432c13c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:19.369147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e919c4fa-8b95-4903-b24d-4a168dac5763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:19.450045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 998/1981] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:19.462353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:19.465718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:19.528991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25636-21e9-40a9-be11-f0be32582c85 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:19.532772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ad4be-0f2a-44dd-9ab8-d2f4e7c3a9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:19.533478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad4be-0f2a-44dd-9ab8-d2f4e7c3a9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:19.533760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad4be-0f2a-44dd-9ab8-d2f4e7c3a9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:19.534036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ad4be-0f2a-44dd-9ab8-d2f4e7c3a9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:19.543981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ad4be-0f2a-44dd-9ab8-d2f4e7c3a9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:19.549008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ad4be-0f2a-44dd-9ab8-d2f4e7c3a9e2 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:19.555136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 984/1982] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:19.985691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:20.271751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919c4fa-8b95-4903-b24d-4a168dac5763 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:20.336540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919c4fa-8b95-4903-b24d-4a168dac5763 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:20.343624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:20.344279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:20.344563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:20.344838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] PATH_INFO: `/v3/users/c689419ec78740f8b2ff9761b9051a87` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:20.345957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c689419ec78740f8b2ff9761b9051a87)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:20.347870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:20.682418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c689419ec78740f8b2ff9761b9051a87'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:20.683359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c689419ec78740f8b2ff9761b9051a87'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:20.683991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c689419ec78740f8b2ff9761b9051a87'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:20.695825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c689419ec78740f8b2ff9761b9051a87'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:20.782582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c689419ec78740f8b2ff9761b9051a87'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:20.805617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 999/1983] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:20 2022] DELETE /identity/v3/users/c689419ec78740f8b2ff9761b9051a87 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:20.809310 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:20.810404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:20.810670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:20.833824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:20.834002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:20.895736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 985/1984] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:20.907769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:20.907904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:20.909466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:20.915720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:20.923655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccfe46-0a3a-4369-9d4f-58b6c5c8d0e0 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:20.929067 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:20.929826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:20.930176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:20.930606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] PATH_INFO: `/v3/users/339c97ab2cd24834a5b3f1fd4ad5b475` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:20.932647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=339c97ab2cd24834a5b3f1fd4ad5b475)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:20.934746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:20.987843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2d16-cfc7-451d-a9b1-72fd61683a86 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:20.991743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64560ffc-be76-49b7-8393-2e47161e3eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:20.992458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560ffc-be76-49b7-8393-2e47161e3eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:20.992737 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560ffc-be76-49b7-8393-2e47161e3eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:20.993627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64560ffc-be76-49b7-8393-2e47161e3eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:21.002849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64560ffc-be76-49b7-8393-2e47161e3eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:21.004372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64560ffc-be76-49b7-8393-2e47161e3eb4 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:21.013636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1000/1985] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:21.202484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339c97ab2cd24834a5b3f1fd4ad5b475'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:21.203311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339c97ab2cd24834a5b3f1fd4ad5b475'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:21.204782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339c97ab2cd24834a5b3f1fd4ad5b475'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:21.214009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339c97ab2cd24834a5b3f1fd4ad5b475'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:21.302928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:21.320808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339c97ab2cd24834a5b3f1fd4ad5b475'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:21.355040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 986/1986] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:20 2022] DELETE /identity/v3/users/339c97ab2cd24834a5b3f1fd4ad5b475 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:21.356902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:21.357510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:21.357995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:21.387918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:21.390106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:21.512349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1001/1987] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:21.542112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:21.545335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:21.626667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4738a-9c17-4cec-b11c-33654f8540d6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:21.630052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:21.630830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:21.631236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:21.631634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:21.643342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:21.644970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:21.657268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 987/1988] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:21.789446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:21.791923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:21.818670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ba6cb-64f7-4697-9ab4-8d980ada2529 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:21.848085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:21.849335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:21.850224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:21.850987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] PATH_INFO: `/v3/projects/b164915c38d747c3b19db49cfccf3c69` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:21.853822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b164915c38d747c3b19db49cfccf3c69)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:21.859243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:21.914756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:21.982205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b164915c38d747c3b19db49cfccf3c69', 'request_id': 'req-7ea621c1-44b6-4d2c-94b1-a58731b3e097'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:21.993531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b164915c38d747c3b19db49cfccf3c69', 'request_id': 'req-7ea621c1-44b6-4d2c-94b1-a58731b3e097'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.054012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b164915c38d747c3b19db49cfccf3c69', 'request_id': 'req-7ea621c1-44b6-4d2c-94b1-a58731b3e097'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.065349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] The token cache is being invalidate because project b164915c38d747c3b19db49cfccf3c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:22.065644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.066292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7ea621c1-44b6-4d2c-94b1-a58731b3e097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.068142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1002/1989] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:21 2022] DELETE /identity/v3/projects/b164915c38d747c3b19db49cfccf3c69 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:22.072762 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:22.091248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc4238-b4da-4e3b-aa79-b3e60125e6b5 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:22.145249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a9d1-1425-4201-b0fe-bd3916462267 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.146068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a9d1-1425-4201-b0fe-bd3916462267 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.146455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a9d1-1425-4201-b0fe-bd3916462267 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:22.148772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1003/1990] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:51:22.159721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.160839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.161323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:22.161479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:22.162322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.162603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.162905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] PATH_INFO: `/v3/users/b22d0e7a9ca74a18a2ec1ff5432c13c9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:22.164121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22d0e7a9ca74a18a2ec1ff5432c13c9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:22.166189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:22.192089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:22.192089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:22.259681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1004/1991] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:51:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:22.270806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:22.272342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:22.286020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c06fb4d-dbf1-41b8-9db3-378c65188994 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:22.291808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:22.292467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.292734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.293011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:22.302268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:22.304007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:22.311667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:22.329765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1005/1992] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:22.331539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:22.334715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:22.350087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1804c82-9657-4c66-b73a-2e05a0ce9bcf service placement] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:22.355601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:22.356305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.358719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.358719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] PATH_INFO: `/v3/users/190c69a502cf4f0ca8eb1de49bd86888` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:22.358719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190c69a502cf4f0ca8eb1de49bd86888)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:22.360003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:22.393167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22d0e7a9ca74a18a2ec1ff5432c13c9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.393788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22d0e7a9ca74a18a2ec1ff5432c13c9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.394444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22d0e7a9ca74a18a2ec1ff5432c13c9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.401661 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22d0e7a9ca74a18a2ec1ff5432c13c9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.533778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22d0e7a9ca74a18a2ec1ff5432c13c9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.557965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 988/1993] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:22 2022] DELETE /identity/v3/users/b22d0e7a9ca74a18a2ec1ff5432c13c9 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:22.558940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:22.560549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:22.608502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190c69a502cf4f0ca8eb1de49bd86888'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.612709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190c69a502cf4f0ca8eb1de49bd86888'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.612709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190c69a502cf4f0ca8eb1de49bd86888'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.625191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190c69a502cf4f0ca8eb1de49bd86888'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.639938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e45ad-0330-4977-956e-3df95232dd64 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:22.644590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:22.645162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.645442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.645845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] PATH_INFO: `/v3/projects/bd4d04a282bc4f2189600eae22f1ebd0` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:22.647010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4d04a282bc4f2189600eae22f1ebd0)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:22.648944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:22.739586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-35cff87c-dc12-44d4-8179-520fdde92f93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190c69a502cf4f0ca8eb1de49bd86888'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.754503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1006/1994] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:22 2022] DELETE /identity/v3/users/190c69a502cf4f0ca8eb1de49bd86888 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:22.760999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4d04a282bc4f2189600eae22f1ebd0', 'request_id': 'req-9ce60a7d-a043-4db4-a227-23e4d66c73f6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.768085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4d04a282bc4f2189600eae22f1ebd0', 'request_id': 'req-9ce60a7d-a043-4db4-a227-23e4d66c73f6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.773481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4d04a282bc4f2189600eae22f1ebd0', 'request_id': 'req-9ce60a7d-a043-4db4-a227-23e4d66c73f6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.870646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] The token cache is being invalidate because project bd4d04a282bc4f2189600eae22f1ebd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:22.870943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.871730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9ce60a7d-a043-4db4-a227-23e4d66c73f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:22.873585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 989/1995] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:22 2022] DELETE /identity/v3/projects/bd4d04a282bc4f2189600eae22f1ebd0 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:22.878424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e418a3-de66-4808-ad45-15bc9a5a1911 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.878934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e418a3-de66-4808-ad45-15bc9a5a1911 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.879211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e418a3-de66-4808-ad45-15bc9a5a1911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:22.900151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f3e418a3-de66-4808-ad45-15bc9a5a1911 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:22.901326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f3e418a3-de66-4808-ad45-15bc9a5a1911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:22.971258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1007/1996] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:22.980518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:22.981039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:22.981324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.000660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:23.001879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.012255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 990/1997] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:23.014797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e418a3-de66-4808-ad45-15bc9a5a1911 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.022413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.025265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.032849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e418a3-de66-4808-ad45-15bc9a5a1911 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.041341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.041801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9f231-c2ff-4256-bd4c-c2da513c928b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.042202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.047040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.047900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.051096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.051096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] PATH_INFO: `/v3/projects/e78bf6d693894c96b17169fd7b23d437` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.051096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e78bf6d693894c96b17169fd7b23d437)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.051434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.051434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.051897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:23.052788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.052901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.054634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.072058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1008/1998] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:23.072058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.072058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.088453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6ae84-3176-4117-a76a-d8b8441e6c23 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.094570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.096320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.096320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.096320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] PATH_INFO: `/v3/projects/d40084384bad48eab73de0baafc0836d` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.097518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40084384bad48eab73de0baafc0836d)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.099524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.182073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e78bf6d693894c96b17169fd7b23d437', 'request_id': 'req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.188020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e78bf6d693894c96b17169fd7b23d437', 'request_id': 'req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.193615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e78bf6d693894c96b17169fd7b23d437', 'request_id': 'req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.212551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40084384bad48eab73de0baafc0836d', 'request_id': 'req-656918a6-e268-43fa-8abe-4daefaa03375'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.219109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40084384bad48eab73de0baafc0836d', 'request_id': 'req-656918a6-e268-43fa-8abe-4daefaa03375'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.280796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] The token cache is being invalidate because project e78bf6d693894c96b17169fd7b23d437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:23.281297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.282518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.283715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 991/1999] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:23 2022] DELETE /identity/v3/projects/e78bf6d693894c96b17169fd7b23d437 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:23.289544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.289544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.352114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f4d51-2d97-4308-84fe-9fbc3d7c2e00 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.359657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40084384bad48eab73de0baafc0836d', 'request_id': 'req-656918a6-e268-43fa-8abe-4daefaa03375'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.370521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] The token cache is being invalidate because project d40084384bad48eab73de0baafc0836d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:23.370811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.371498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-656918a6-e268-43fa-8abe-4daefaa03375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:23.373046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1009/2000] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:23 2022] DELETE /identity/v3/projects/d40084384bad48eab73de0baafc0836d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:23.374295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69416b0-2caa-42c6-9546-868ef0ac846d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.374583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69416b0-2caa-42c6-9546-868ef0ac846d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.375065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69416b0-2caa-42c6-9546-868ef0ac846d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.394768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a69416b0-2caa-42c6-9546-868ef0ac846d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:23.397585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a69416b0-2caa-42c6-9546-868ef0ac846d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.408515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.409164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.409448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.409729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.410357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.412336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.454900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1010/2001] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:23.456535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefeead-257a-4c16-b6de-36a969f68a26 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.456823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefeead-257a-4c16-b6de-36a969f68a26 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.457100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefeead-257a-4c16-b6de-36a969f68a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.476052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fcefeead-257a-4c16-b6de-36a969f68a26 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:23.477290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fcefeead-257a-4c16-b6de-36a969f68a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.485634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1011/2002] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:23.486936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4749c64-7faf-45ad-b92d-3e8e966cc26d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.487297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4749c64-7faf-45ad-b92d-3e8e966cc26d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.487639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4749c64-7faf-45ad-b92d-3e8e966cc26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.507539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b4749c64-7faf-45ad-b92d-3e8e966cc26d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:23.509472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b4749c64-7faf-45ad-b92d-3e8e966cc26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.521128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1012/2003] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:23.521290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 992/2004] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:23.521399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.521399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.521399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.524785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.542502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:23.543783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.596460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e2d86-f0fe-4023-b3b0-07aefae89673 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.601304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.601990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.602386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.602719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.603589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:23.603967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.605816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.607050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1013/2005] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:23.610402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.612391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:23.623547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 993/2006] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:23.623547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.625543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8305e64-9df6-4118-af20-22113db92d27 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.630244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.630855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.631140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.631419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.632048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.632767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f6d9a-7a2b-4ae1-9847-ee7ca32735a2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.634677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.638203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.638800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.639116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.639396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.640171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:23.642393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.644031 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.648129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:23.659069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 994/2007] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:23.659840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.669269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3721d-5157-49d5-862e-830b57551bdb admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.673898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.674461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.674833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.675114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.675722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.677621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.707021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:23.712610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1014/2008] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:23.714710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.723626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c596c96-9637-46b1-a544-4dbef65aae5a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.729281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.729281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.729281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.732397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.732397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.732397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.792545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 995/2009] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:23.792545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.846217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1015/2010] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:23.846940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.850381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0e83-b32a-44bc-9024-40257a8e2d8c admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.910877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.911498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.911791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.912072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.912752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.914480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.920782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bbbef-8334-4f9b-a315-f3bf5131b015 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.929514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.929645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 996/2011] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:23.929764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.929764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.929764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.930005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:23.930201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.931505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:23.937992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434123-52ac-4ad3-829b-ba13c7f895bb admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:23.942586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:23.943168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:23.943445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:23.943719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:23.944372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:23.946370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.016505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1016/2012] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:24.017268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.026769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac4aff-6574-406d-9401-51a1d1500d74 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.031486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.032062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.032381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.032667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.033420 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.035023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.045467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1017/2013] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:24.047299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 997/2014] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:23 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:24.047428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.051527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.056997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2503cd0a-afb6-45d5-a35d-e18a7d62ba1b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.061733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.062333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.062621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.062899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.063019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd111c4-3f46-4397-b455-eed5da8ad4cc admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.063542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.065186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.067895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.068714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.069043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.069323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] PATH_INFO: `/v3/projects/c34c30608cdf4093b4b5c6f731c1043f/users/b08d011c70e14b8390400ac8c46b7ed1/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.075606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1018/2015] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:24.076430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.084573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34c30608cdf4093b4b5c6f731c1043f, user_id=b08d011c70e14b8390400ac8c46b7ed1, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.086053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24479e34-de23-4b7b-8032-a61e9a2c52d0 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.087297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.090793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.091288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.091568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.091843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.092509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.094067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.104213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1019/2016] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:24.104997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.113945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e4ee1-822d-44f8-adf2-4c88b9244119 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.119154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.119710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.119990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.120300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.120917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.122457 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.132244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1020/2017] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:24.133199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.142461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee32faa8-3f6e-47b8-894e-dfd21c7f9b0c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.147290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.147852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.148135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.148445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.153846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.153846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.164603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1021/2018] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:24.164603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.176886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf3dcc-9c96-49e8-aa22-9dd8f1e6d8d7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.180426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 998/2019] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:24 2022] PUT /identity/v3/projects/c34c30608cdf4093b4b5c6f731c1043f/users/b08d011c70e14b8390400ac8c46b7ed1/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:24.181994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.239116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d90ad-20c5-42c4-b6d8-9e8498a3cf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.239786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d90ad-20c5-42c4-b6d8-9e8498a3cf28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.240066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d90ad-20c5-42c4-b6d8-9e8498a3cf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.240380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d90ad-20c5-42c4-b6d8-9e8498a3cf28 admin admin] PATH_INFO: `/v3/projects/ee0feb8131c44e458f56fda76810c653/users/87028c199aab4a51b75d579c3f29554f/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.255889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d90ad-20c5-42c4-b6d8-9e8498a3cf28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0feb8131c44e458f56fda76810c653, user_id=87028c199aab4a51b75d579c3f29554f, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.258615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d90ad-20c5-42c4-b6d8-9e8498a3cf28 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.264182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d993d2-0121-4c61-ae7d-be333a3581b2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.274621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be80a5-f4d2-43d4-a2e5-cd6990a88dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.274621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be80a5-f4d2-43d4-a2e5-cd6990a88dbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.274621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be80a5-f4d2-43d4-a2e5-cd6990a88dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.274621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be80a5-f4d2-43d4-a2e5-cd6990a88dbd admin admin] PATH_INFO: `/v3/projects/37dc2dd00cfe462089946ed95362a5cf/users/ff09e280672f49f3b26a5a48a37ca93d/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.287447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be80a5-f4d2-43d4-a2e5-cd6990a88dbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dc2dd00cfe462089946ed95362a5cf, user_id=ff09e280672f49f3b26a5a48a37ca93d, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.292399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be80a5-f4d2-43d4-a2e5-cd6990a88dbd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.356866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1022/2020] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:24 2022] PUT /identity/v3/projects/ee0feb8131c44e458f56fda76810c653/users/87028c199aab4a51b75d579c3f29554f/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:24.358104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d721b6-c48e-474a-bfcb-4155dd113b7f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.358404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d721b6-c48e-474a-bfcb-4155dd113b7f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.358667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d721b6-c48e-474a-bfcb-4155dd113b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.377437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f1d721b6-c48e-474a-bfcb-4155dd113b7f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:24.378649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f1d721b6-c48e-474a-bfcb-4155dd113b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:24.379833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 999/2021] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:24 2022] PUT /identity/v3/projects/37dc2dd00cfe462089946ed95362a5cf/users/ff09e280672f49f3b26a5a48a37ca93d/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:24.389509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.389798 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.390082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.419454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] MFA Rules not processed for user `87028c199aab4a51b75d579c3f29554f`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:24.420699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:24.437551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1023/2022] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:24.439044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.439336 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.439615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.468734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] MFA Rules not processed for user `ff09e280672f49f3b26a5a48a37ca93d`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:24.469955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:24.487172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1000/2023] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:24.488011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.489653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:24.536522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1024/2024] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:24.537381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.538959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:24.549742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695db7a4-f4ed-4c52-8faf-5c4f2eaa5d03 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.553756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.554400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.554752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.555128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.564397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.565849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.575677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1001/2025] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:24.576515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.577766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:24.599216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdb71a-5569-4a5c-9844-30ef878e9ca9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.603379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.604158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.604413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.604704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.614111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.615595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.625028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1025/2026] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:24.639204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c20590-efd1-44ef-bd02-6498f04da0b3 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.642837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98510cd-7b07-4331-9498-20e7f3b0c578 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.643457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98510cd-7b07-4331-9498-20e7f3b0c578 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.643743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98510cd-7b07-4331-9498-20e7f3b0c578 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.644020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98510cd-7b07-4331-9498-20e7f3b0c578 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.644946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:24.653280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98510cd-7b07-4331-9498-20e7f3b0c578 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.654892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98510cd-7b07-4331-9498-20e7f3b0c578 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.655631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ee397-c984-47a1-9e48-e59f958a0889 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:24.660271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:24.660886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:24.661165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:24.661442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] PATH_INFO: `/v3/users/87028c199aab4a51b75d579c3f29554f` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:24.662558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=87028c199aab4a51b75d579c3f29554f)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:24.664562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:24.664727 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1002/2027] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:24.851159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:24.906362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87028c199aab4a51b75d579c3f29554f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:24.907048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87028c199aab4a51b75d579c3f29554f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:24.907660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87028c199aab4a51b75d579c3f29554f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:24.919573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:24.921999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87028c199aab4a51b75d579c3f29554f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:25.033633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87028c199aab4a51b75d579c3f29554f'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:25.046756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1026/2028] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:24 2022] DELETE /identity/v3/users/87028c199aab4a51b75d579c3f29554f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:25.051826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:25.052086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:25.052398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:25.073335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:25.074875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:25.139866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1003/2029] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:25.149391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:25.150832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:25.212222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5c3d4-ae1b-44f8-826f-e5230e7ba6aa admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:25.216340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49326d3d-a3b5-4643-9495-dcf00557b104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:25.216961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49326d3d-a3b5-4643-9495-dcf00557b104 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:25.217347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49326d3d-a3b5-4643-9495-dcf00557b104 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:25.217865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49326d3d-a3b5-4643-9495-dcf00557b104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:25.227797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49326d3d-a3b5-4643-9495-dcf00557b104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:25.229348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49326d3d-a3b5-4643-9495-dcf00557b104 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:25.240419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1027/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:25.744909 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:25.746352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:25.762055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58704b-e496-47f6-814a-c2ae727c3c32 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:25.769166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:25.770030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:25.770465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:25.770781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] PATH_INFO: `/v3/projects/ee0feb8131c44e458f56fda76810c653` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:25.772061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0feb8131c44e458f56fda76810c653)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:25.778720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:25.931370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0feb8131c44e458f56fda76810c653', 'request_id': 'req-a54b0360-89f0-48ee-b1f7-05521fc92df2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:25.937763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0feb8131c44e458f56fda76810c653', 'request_id': 'req-a54b0360-89f0-48ee-b1f7-05521fc92df2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:25.943384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0feb8131c44e458f56fda76810c653', 'request_id': 'req-a54b0360-89f0-48ee-b1f7-05521fc92df2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.009726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.010017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.010296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.031549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] The token cache is being invalidate because project ee0feb8131c44e458f56fda76810c653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:26.034208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.034208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a54b0360-89f0-48ee-b1f7-05521fc92df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.034625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1004/2031] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:25 2022] DELETE /identity/v3/projects/ee0feb8131c44e458f56fda76810c653 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:26.039357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e91fc-3bc7-46f7-b019-871021f77eb3 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.040457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e91fc-3bc7-46f7-b019-871021f77eb3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.040842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e91fc-3bc7-46f7-b019-871021f77eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.043091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] MFA Rules not processed for user `b08d011c70e14b8390400ac8c46b7ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:26.045097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.063295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c82e91fc-3bc7-46f7-b019-871021f77eb3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:26.064665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c82e91fc-3bc7-46f7-b019-871021f77eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.116546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1028/2032] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:26.129165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.129424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1005/2033] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:26.130590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.136761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fae76-24ea-48ab-9a14-fe8fa00e5b39 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.137055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fae76-24ea-48ab-9a14-fe8fa00e5b39 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.137339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fae76-24ea-48ab-9a14-fe8fa00e5b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.156489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3f2fae76-24ea-48ab-9a14-fe8fa00e5b39 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:26.157692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3f2fae76-24ea-48ab-9a14-fe8fa00e5b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.166935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1006/2034] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:26.171423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fae76-24ea-48ab-9a14-fe8fa00e5b39 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.181096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fae76-24ea-48ab-9a14-fe8fa00e5b39 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.185888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.186491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.186781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.187061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.187354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6398f-df6d-44e8-b6f2-48b7518f4d9a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.187715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:26.188025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.189648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.191122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.191711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.192003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.192322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.200567 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.202003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.206221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1007/2035] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:51:26.207044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.211146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1029/2036] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:26.216735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacc659-c61d-4f6d-aa4b-d3460f4d2b70 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.221423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.226862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.226862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.226862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.226862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.226862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.268014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:26.336363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1008/2037] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:26 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:26.337485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.349554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02371abb-9d83-4b9b-b9b7-b2dcbdef2532 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.372490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:26.412676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.413281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.413736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.414023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.416298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.418304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.428039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.429738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.442266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddf952-443b-4cfd-828e-801725000706 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.446935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.447565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.447847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.448130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] PATH_INFO: `/v3/users/94f93c5f17974c47beb1f62059047370` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.449346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f93c5f17974c47beb1f62059047370)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.451305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.575097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1030/2038] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:26 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:26.576325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.596211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca49e9f-2d1c-4ad6-a775-ad4ee2cb2a09 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.602086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.603279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.603636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.604006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.604761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.606503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.622852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1031/2039] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:26.625669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.636109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5f98-29ba-43fc-987b-2bf0401c35c3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.641309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.641949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.642236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.642515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.643186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.644981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.661563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1032/2040] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:26.663262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.674854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e3e9d-8d92-4e1a-8dc1-f78e5e530bb9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.680424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc03b3-9394-4e8e-aa4d-fa9977ccdc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.685357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc03b3-9394-4e8e-aa4d-fa9977ccdc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.685357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc03b3-9394-4e8e-aa4d-fa9977ccdc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.685357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc03b3-9394-4e8e-aa4d-fa9977ccdc37 admin admin] PATH_INFO: `/v3/projects/83b34689ea414253a1700a8e057bfa46/users/e0a261a926d04a8bbda99b6a2154c010/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.698965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc03b3-9394-4e8e-aa4d-fa9977ccdc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b34689ea414253a1700a8e057bfa46, user_id=e0a261a926d04a8bbda99b6a2154c010, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:26.702346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc03b3-9394-4e8e-aa4d-fa9977ccdc37 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:26.723470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f93c5f17974c47beb1f62059047370'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.725149 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f93c5f17974c47beb1f62059047370'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.726037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f93c5f17974c47beb1f62059047370'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.735244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f93c5f17974c47beb1f62059047370'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.814085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a522da4-7f32-4980-a78d-0c5f7b09e3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f93c5f17974c47beb1f62059047370'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:26.825907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1033/2041] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:26 2022] PUT /identity/v3/projects/83b34689ea414253a1700a8e057bfa46/users/e0a261a926d04a8bbda99b6a2154c010/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:26.831409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.831774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.832170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.838988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1009/2042] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:26 2022] DELETE /identity/v3/users/94f93c5f17974c47beb1f62059047370 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:26.843292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.843585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.852205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:26.854678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:26.855925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.863584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:26.864845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.916651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1034/2043] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:26.924613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1010/2044] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:26.928586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.931009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.933057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:26.934636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:26.994026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f1431-ed10-4162-93b3-437cc40c96b7 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:26.997884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:26.998444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:26.998728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:26.999007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:27.006379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05845ab0-586d-418f-baab-224ba12fe590 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:27.008960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:27.010556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:27.010697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9733c-7144-4248-b96c-72054ed9ae2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:27.011244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9733c-7144-4248-b96c-72054ed9ae2e service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:27.011589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9733c-7144-4248-b96c-72054ed9ae2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:27.012169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9733c-7144-4248-b96c-72054ed9ae2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:27.021176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1035/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:27.027219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9733c-7144-4248-b96c-72054ed9ae2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:27.028665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9733c-7144-4248-b96c-72054ed9ae2e service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:27.038698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1011/2046] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:27.612107 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:27.614570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:27.628851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39928faf-66f0-4046-844d-af04c43fa036 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:27.633642 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:27.637186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:27.637186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:27.637186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] PATH_INFO: `/v3/projects/a2f070e312d34a4588363283796fa298` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:27.637186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f070e312d34a4588363283796fa298)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:27.637970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:27.761502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f070e312d34a4588363283796fa298', 'request_id': 'req-d435838c-3657-48ee-b381-92a0994d9eed'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:27.767649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f070e312d34a4588363283796fa298', 'request_id': 'req-d435838c-3657-48ee-b381-92a0994d9eed'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:27.831952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:27.832948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f070e312d34a4588363283796fa298', 'request_id': 'req-d435838c-3657-48ee-b381-92a0994d9eed'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:27.846678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] The token cache is being invalidate because project a2f070e312d34a4588363283796fa298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:27.847023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:27.847637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d435838c-3657-48ee-b381-92a0994d9eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:27.849539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1036/2047] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:27 2022] DELETE /identity/v3/projects/a2f070e312d34a4588363283796fa298 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:27.854740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8cf04-5a28-42c0-bbb0-7650348e74ac None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:27.855227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8cf04-5a28-42c0-bbb0-7650348e74ac None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:27.855538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8cf04-5a28-42c0-bbb0-7650348e74ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:27.877297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-96d8cf04-5a28-42c0-bbb0-7650348e74ac None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:27.878649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-96d8cf04-5a28-42c0-bbb0-7650348e74ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:27.955302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1012/2048] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:27.963568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651905-e959-4068-9705-d78336ae1f69 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:27.963866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651905-e959-4068-9705-d78336ae1f69 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:27.964151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c651905-e959-4068-9705-d78336ae1f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:27.984774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2c651905-e959-4068-9705-d78336ae1f69 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:27.985976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2c651905-e959-4068-9705-d78336ae1f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:27.993978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1037/2049] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:27.998495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8cf04-5a28-42c0-bbb0-7650348e74ac None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:28.008180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8cf04-5a28-42c0-bbb0-7650348e74ac None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:28.012868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13df51-097f-4042-ba1e-89c796e586ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:28.013474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13df51-097f-4042-ba1e-89c796e586ea admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.013761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13df51-097f-4042-ba1e-89c796e586ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.014041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13df51-097f-4042-ba1e-89c796e586ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.014713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13df51-097f-4042-ba1e-89c796e586ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:28.015026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13df51-097f-4042-ba1e-89c796e586ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:28.016656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13df51-097f-4042-ba1e-89c796e586ea admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:28.029561 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1013/2050] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:51:28.033455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651905-e959-4068-9705-d78336ae1f69 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:28.043442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c651905-e959-4068-9705-d78336ae1f69 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:28.048455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:28.049246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.049683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.049961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.050597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:28.052521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:28.096663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679c923-f44f-45c0-8461-4827e440e6c6 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.097107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679c923-f44f-45c0-8461-4827e440e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.097452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679c923-f44f-45c0-8461-4827e440e6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.118391 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f679c923-f44f-45c0-8461-4827e440e6c6 None None] MFA Rules not processed for user `b08d011c70e14b8390400ac8c46b7ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:28.119621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f679c923-f44f-45c0-8461-4827e440e6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:28.141325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1038/2051] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:28 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:28.145538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:28.176827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1014/2052] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:28.206229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c741c5a-c8d1-4317-8177-ff9b6d0acd35 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:28.212594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:28.213214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.213502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.213897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.214648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:28.216634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:28.348002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1039/2053] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:28 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:28.353170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679c923-f44f-45c0-8461-4827e440e6c6 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:28.374257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679c923-f44f-45c0-8461-4827e440e6c6 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:28.387140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:28.387769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.388056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.388416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.389074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:28.392277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:28.405520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1015/2054] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:28.407264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:28.423514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9beae-49b4-4d84-9f04-1e2f0b9533e1 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:28.428693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69ba0e-398c-4014-a9d3-e0f8cde189c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:28.429312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69ba0e-398c-4014-a9d3-e0f8cde189c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.429598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69ba0e-398c-4014-a9d3-e0f8cde189c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.429878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69ba0e-398c-4014-a9d3-e0f8cde189c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.430542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69ba0e-398c-4014-a9d3-e0f8cde189c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:28.432387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69ba0e-398c-4014-a9d3-e0f8cde189c5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:28.445450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1040/2055] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:28.450101 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:28.470172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c580e6-ce38-4c1d-ad28-1ca08a700dd2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:28.475323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184a54e-e17b-4aef-a102-4fec7020d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:28.476138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184a54e-e17b-4aef-a102-4fec7020d4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.476519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184a54e-e17b-4aef-a102-4fec7020d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.476897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184a54e-e17b-4aef-a102-4fec7020d4c8 admin admin] PATH_INFO: `/v3/projects/7c3e4838227b4349962d8926a529d30a/users/e33ec910f8eb448b899dfbf59c65d355/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.494356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184a54e-e17b-4aef-a102-4fec7020d4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3e4838227b4349962d8926a529d30a, user_id=e33ec910f8eb448b899dfbf59c65d355, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:28.497277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184a54e-e17b-4aef-a102-4fec7020d4c8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:28.515661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.521241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.521241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.539544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:28.552893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] MFA Rules not processed for user `e0a261a926d04a8bbda99b6a2154c010`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:28.554216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:28.596928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1016/2056] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:28 2022] PUT /identity/v3/projects/7c3e4838227b4349962d8926a529d30a/users/e33ec910f8eb448b899dfbf59c65d355/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:28.607774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.608063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.608398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.641553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] MFA Rules not processed for user `e33ec910f8eb448b899dfbf59c65d355`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:28.642973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:28.643638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1041/2057] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:28.659250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:28.660806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:28.735786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e3b6b-1620-474b-b6ac-7cebf108f5df None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:28.740237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1017/2058] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:28.784445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efadba-8125-4a4a-a75d-8d8260bfce9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:28.785056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efadba-8125-4a4a-a75d-8d8260bfce9d service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:28.785345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efadba-8125-4a4a-a75d-8d8260bfce9d service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:28.785634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efadba-8125-4a4a-a75d-8d8260bfce9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:28.840900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efadba-8125-4a4a-a75d-8d8260bfce9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:28.842354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efadba-8125-4a4a-a75d-8d8260bfce9d service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:28.851204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1042/2059] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:29.240093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:29.241526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:29.253933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589746-cf9d-47d6-a9d3-72a38ddba656 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:29.258040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:29.258667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:29.259008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:29.259286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:29.267823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:29.269293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:29.278036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1018/2060] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:30.376503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:30.773578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cddc1-56da-4270-8157-a497c9222229 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:30.773884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cddc1-56da-4270-8157-a497c9222229 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:30.774148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cddc1-56da-4270-8157-a497c9222229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:30.793710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2d7cddc1-56da-4270-8157-a497c9222229 None None] MFA Rules not processed for user `e0a261a926d04a8bbda99b6a2154c010`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:30.794999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2d7cddc1-56da-4270-8157-a497c9222229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:30.802596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1043/2061] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:31.145596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:32.491469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:33.190537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:33.852174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:33.916406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bb00f-41f4-4103-be8e-fd54212d410f service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:33.919112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:33.919740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:33.920023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:33.920340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] PATH_INFO: `/v3/users/e33ec910f8eb448b899dfbf59c65d355` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:33.921462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33ec910f8eb448b899dfbf59c65d355)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:33.923422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:34.170754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33ec910f8eb448b899dfbf59c65d355'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:34.171451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33ec910f8eb448b899dfbf59c65d355'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:34.174402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33ec910f8eb448b899dfbf59c65d355'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:34.183634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33ec910f8eb448b899dfbf59c65d355'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:34.293804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33ec910f8eb448b899dfbf59c65d355'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:34.294487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:34.316413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1019/2062] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:33 2022] DELETE /identity/v3/users/e33ec910f8eb448b899dfbf59c65d355 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:34.321482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:34.321889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:34.322274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:34.341931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:34.343241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:34.411658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1044/2063] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:34.418298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:34.419856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:34.481097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89d39c-857d-4417-b808-7675936ebbf8 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:34.484831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc35bb0-3366-46f1-bdfb-651040c47f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:34.485474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc35bb0-3366-46f1-bdfb-651040c47f2d service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:34.485766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc35bb0-3366-46f1-bdfb-651040c47f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:34.486048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc35bb0-3366-46f1-bdfb-651040c47f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:34.494932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:34.500268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc35bb0-3366-46f1-bdfb-651040c47f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:34.500268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc35bb0-3366-46f1-bdfb-651040c47f2d service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:34.509225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1020/2064] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:35.106178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.107780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:35.120914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c3c1c-e701-40ac-9d07-32c3caa4377d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.125966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.126715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.126993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.127268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] PATH_INFO: `/v3/projects/7c3e4838227b4349962d8926a529d30a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.129350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3e4838227b4349962d8926a529d30a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.131294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:35.274158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3e4838227b4349962d8926a529d30a', 'request_id': 'req-334964b1-ebcd-4c9f-af9a-a3dd71d30542'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:35.280318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3e4838227b4349962d8926a529d30a', 'request_id': 'req-334964b1-ebcd-4c9f-af9a-a3dd71d30542'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:35.347779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3e4838227b4349962d8926a529d30a', 'request_id': 'req-334964b1-ebcd-4c9f-af9a-a3dd71d30542'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:35.359566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] The token cache is being invalidate because project 7c3e4838227b4349962d8926a529d30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:35.359931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:35.360594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-334964b1-ebcd-4c9f-af9a-a3dd71d30542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:35.362145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1045/2065] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:35 2022] DELETE /identity/v3/projects/7c3e4838227b4349962d8926a529d30a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:35.369228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743beb1-6815-44cc-a29c-5628e24f76a9 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.369707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743beb1-6815-44cc-a29c-5628e24f76a9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.369811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743beb1-6815-44cc-a29c-5628e24f76a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.389231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0743beb1-6815-44cc-a29c-5628e24f76a9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:35.390441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0743beb1-6815-44cc-a29c-5628e24f76a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:35.440698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:35.449429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1021/2066] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:35.458923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d47e-8fde-4d9b-aed0-e16d49265436 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.459215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d47e-8fde-4d9b-aed0-e16d49265436 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.459526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803d47e-8fde-4d9b-aed0-e16d49265436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.480514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-3803d47e-8fde-4d9b-aed0-e16d49265436 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:35.481760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3803d47e-8fde-4d9b-aed0-e16d49265436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:35.492789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1046/2067] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:35.500239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743beb1-6815-44cc-a29c-5628e24f76a9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.506830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743beb1-6815-44cc-a29c-5628e24f76a9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.511691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.512265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.512562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.512845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.513528 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:35.513842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.515445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:35.527370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1022/2068] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:35.537613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d47e-8fde-4d9b-aed0-e16d49265436 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.547505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803d47e-8fde-4d9b-aed0-e16d49265436 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.552217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.552815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.553094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.553367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.553989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.555909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:35.673958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1047/2069] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:35 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:35.678135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.682084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:35.689853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f095-2411-4f23-971a-c7042c055803 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.749051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.749673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.749970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.750246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.750899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.752906 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:35.857924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1023/2070] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:35 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:35.860439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.872370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540e32e-d175-46f6-9bbf-54ba3ed623c2 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.873381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.875182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:35.876908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.877683 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.882254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.882254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.882254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.882254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:35.887790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a1501-fd13-4d13-b8b5-f20a24df0d98 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.896114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.896442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1048/2071] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:35.896554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.896554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.896554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] PATH_INFO: `/v3/users/ff09e280672f49f3b26a5a48a37ca93d` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.897526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff09e280672f49f3b26a5a48a37ca93d)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.897625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.900138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:35.908535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33e785-d9a2-4339-9acb-f802b81bfd92 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.915589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.916317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.916676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.917042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.917796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.919542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:35.931356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1049/2072] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:35.940651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:35.951177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383d7cb-bac5-4941-9446-6343f37e512f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:35.956088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3d5b7-7481-402c-b81d-9ba662b61960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:35.956769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d5b7-7481-402c-b81d-9ba662b61960 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:35.957057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d5b7-7481-402c-b81d-9ba662b61960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:35.957334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3d5b7-7481-402c-b81d-9ba662b61960 admin admin] PATH_INFO: `/v3/projects/e8d068217678468c831713b9f67e756d/users/40065b00882f45e38206aa56847efbd5/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:35.974069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3d5b7-7481-402c-b81d-9ba662b61960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8d068217678468c831713b9f67e756d, user_id=40065b00882f45e38206aa56847efbd5, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:35.976794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3d5b7-7481-402c-b81d-9ba662b61960 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:36.054737 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1050/2073] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:35 2022] PUT /identity/v3/projects/e8d068217678468c831713b9f67e756d/users/40065b00882f45e38206aa56847efbd5/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:36.065935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:36.066652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:36.067174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:36.103514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] MFA Rules not processed for user `40065b00882f45e38206aa56847efbd5`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:36.109644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff09e280672f49f3b26a5a48a37ca93d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:36.109644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff09e280672f49f3b26a5a48a37ca93d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:36.109644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff09e280672f49f3b26a5a48a37ca93d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:36.111713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:36.116513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff09e280672f49f3b26a5a48a37ca93d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:36.189205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b7cf5cf0-5e68-419a-aa7c-92176e7f3b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff09e280672f49f3b26a5a48a37ca93d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:36.193873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:36.200322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1051/2074] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:36.209691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1024/2075] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:35 2022] DELETE /identity/v3/users/ff09e280672f49f3b26a5a48a37ca93d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:36.212180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:36.214251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:36.216773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:36.217063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:36.217476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:36.240951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:36.242688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:36.313553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b7b75-5b30-47f2-a3d6-7680cafd99c8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:36.328819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1025/2076] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:36.338943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:36.341015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:36.348901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:36.379368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360e381-db79-4409-9665-6a05b732caea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:36.380673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360e381-db79-4409-9665-6a05b732caea service glance] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:36.381169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360e381-db79-4409-9665-6a05b732caea service glance] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:36.381659 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360e381-db79-4409-9665-6a05b732caea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:36.404287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17b32c-8717-4fc0-8da7-653ad862be98 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:36.408045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:36.408740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:36.409002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:36.409278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:36.418659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:36.420104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:36.431496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1026/2077] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:36.444430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360e381-db79-4409-9665-6a05b732caea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:36.446555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360e381-db79-4409-9665-6a05b732caea service glance] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:36.455861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1052/2078] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:51:36.927090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:36.987499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:37.277478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:37.279181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:37.308328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e4f25-4785-4875-8a08-ad214c4f82de service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:37.320835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:37.320835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:37.320835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:37.320835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] PATH_INFO: `/v3/projects/37dc2dd00cfe462089946ed95362a5cf` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:37.328720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dc2dd00cfe462089946ed95362a5cf)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:37.328720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:37.520093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dc2dd00cfe462089946ed95362a5cf', 'request_id': 'req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:37.528244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dc2dd00cfe462089946ed95362a5cf', 'request_id': 'req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:37.534284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dc2dd00cfe462089946ed95362a5cf', 'request_id': 'req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:37.627574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] The token cache is being invalidate because project 37dc2dd00cfe462089946ed95362a5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:37.627876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:37.628533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3bceb4d8-fac8-41c0-80d3-c6b18aa47750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:37.630024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1027/2079] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:37 2022] DELETE /identity/v3/projects/37dc2dd00cfe462089946ed95362a5cf => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:37.635420 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c30dec-8a67-44da-93a0-682b60382bb4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:37.635894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c30dec-8a67-44da-93a0-682b60382bb4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:37.636000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c30dec-8a67-44da-93a0-682b60382bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:37.660021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-77c30dec-8a67-44da-93a0-682b60382bb4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:37.661319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-77c30dec-8a67-44da-93a0-682b60382bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:37.730354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1053/2080] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:37.738932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f50df-8ddf-4f46-9a0a-b84517882242 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:37.739322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f50df-8ddf-4f46-9a0a-b84517882242 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:37.739690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f50df-8ddf-4f46-9a0a-b84517882242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:37.761477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-291f50df-8ddf-4f46-9a0a-b84517882242 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:37.762674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-291f50df-8ddf-4f46-9a0a-b84517882242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:37.771033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1028/2081] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:37.775440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c30dec-8a67-44da-93a0-682b60382bb4 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:37.786453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c30dec-8a67-44da-93a0-682b60382bb4 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:37.791883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:37.792536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:37.792817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:37.793093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:37.793883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:37.794317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:37.796374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:37.809488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1054/2082] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:37.813396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f50df-8ddf-4f46-9a0a-b84517882242 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:37.822857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:37.825231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f50df-8ddf-4f46-9a0a-b84517882242 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:37.830811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:37.831429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:37.832325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:37.832325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:37.833204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:37.838354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:37.858661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:37.917848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1029/2083] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:37 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:37.922112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:37.935828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb2d7f-2d88-4114-8def-9eecfb4ff3bb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:37.995796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:37.996447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:37.996733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:37.997008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:37.997632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:37.999585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:38.110667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1055/2084] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:37 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:38.116547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:38.127828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db73212-4e27-4f37-b776-552a5007e25d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:38.133074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:38.136936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:38.136936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:38.136936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:38.136936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:38.137392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:38.147201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1030/2085] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:38.151383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:38.161990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d120b-ee9e-4c4c-9809-4f125678e438 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:38.167376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55858f-ee51-4443-a85e-6eae72b7f4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:38.167983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55858f-ee51-4443-a85e-6eae72b7f4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:38.168399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55858f-ee51-4443-a85e-6eae72b7f4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:38.168733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55858f-ee51-4443-a85e-6eae72b7f4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:38.169351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55858f-ee51-4443-a85e-6eae72b7f4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:38.170976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f55858f-ee51-4443-a85e-6eae72b7f4a0 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:38.182731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1056/2086] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:38.186718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:38.197571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f878d-e1e5-4b31-93a8-b696d5450823 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:38.203338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:38.204008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:38.204388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:38.204672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] PATH_INFO: `/v3/projects/c3e3f63e56534888b29d97b2ea5ff924/users/9aae4371a13c4004a2b82755e5b8d4f2/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:38.220718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e3f63e56534888b29d97b2ea5ff924, user_id=9aae4371a13c4004a2b82755e5b8d4f2, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:38.223355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:38.486222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:38.491953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1031/2087] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:38 2022] PUT /identity/v3/projects/c3e3f63e56534888b29d97b2ea5ff924/users/9aae4371a13c4004a2b82755e5b8d4f2/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:38.497174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643f226-f292-48dd-ad87-f5019d939950 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:38.497547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643f226-f292-48dd-ad87-f5019d939950 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:38.497893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643f226-f292-48dd-ad87-f5019d939950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:38.517257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f643f226-f292-48dd-ad87-f5019d939950 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:38.518490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f643f226-f292-48dd-ad87-f5019d939950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:38.549681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:38.632121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1057/2088] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:38.643569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:38.645464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:38.714162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1a705-5083-4206-b7a3-49509d31e46d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:38.717707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:38.718312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:38.718592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:38.718867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:38.729052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:38.730751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:38.743680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1032/2089] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:39.045079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:39.188344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:39.584384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:39.784847 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:40.206754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a34426-6be3-4198-8509-5b45dd173e4b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:40.207419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a34426-6be3-4198-8509-5b45dd173e4b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:40.207524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a34426-6be3-4198-8509-5b45dd173e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:40.237229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-71a34426-6be3-4198-8509-5b45dd173e4b None None] MFA Rules not processed for user `9aae4371a13c4004a2b82755e5b8d4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:40.238588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-71a34426-6be3-4198-8509-5b45dd173e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:40.308306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:40.325078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1058/2090] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:40.329586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:40.340384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55926e-017f-4536-9331-6ac7e77bcf85 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:40.345116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:40.345857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:40.346145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:40.346425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:40.347154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:40.349192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:40.467569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1033/2091] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:40 2022] POST /identity/v3/projects => generated 403 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:40.471876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a34426-6be3-4198-8509-5b45dd173e4b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:40.483990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a34426-6be3-4198-8509-5b45dd173e4b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:40.562885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:40.563012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:40.563377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:40.563752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:40.565022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:40.566856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:40.704229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1059/2092] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:40 2022] POST /identity/v3/users => generated 308 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:40.708863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:40.721231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6d365-0e00-4e95-9d42-51c1c779ebdd admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:40.726514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:40.727488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:40.727939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:40.728252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:40.728901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:40.730504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:40.740968 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1034/2093] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:40.745648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:40.756664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3d881-6ba6-4ac4-a625-396b3fac4c6c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:40.766005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:40.766005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:40.766374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:40.766547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] PATH_INFO: `/v3/projects/c2b3f9ac501540d497cdea9a4d43e527/users/76615d678aed4857916590e9531a1d01/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:40.784561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b3f9ac501540d497cdea9a4d43e527, user_id=76615d678aed4857916590e9531a1d01, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:40.790397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:40.873383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1060/2094] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:40 2022] PUT /identity/v3/projects/c2b3f9ac501540d497cdea9a4d43e527/users/76615d678aed4857916590e9531a1d01/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:40.877774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:40.890877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539f919-e200-4c72-96cb-105ab91b34b9 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:40.962526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a397fe-0849-4cf8-a480-8748340ac18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:40.963399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a397fe-0849-4cf8-a480-8748340ac18c admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:40.963831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a397fe-0849-4cf8-a480-8748340ac18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:40.964250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a397fe-0849-4cf8-a480-8748340ac18c admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:40.965574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a397fe-0849-4cf8-a480-8748340ac18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:40.967398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a397fe-0849-4cf8-a480-8748340ac18c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:40.980089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1035/2095] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:40.985218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:41.002507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e6b8d-9d07-457a-ba30-70123c49c6c0 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:41.008259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b998d8-02e6-404e-82dd-530756e0980e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:41.009573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b998d8-02e6-404e-82dd-530756e0980e admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:41.009950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b998d8-02e6-404e-82dd-530756e0980e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:41.010327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b998d8-02e6-404e-82dd-530756e0980e admin admin] PATH_INFO: `/v3/projects/c2b3f9ac501540d497cdea9a4d43e527/users/76615d678aed4857916590e9531a1d01/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:41.012588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b998d8-02e6-404e-82dd-530756e0980e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b3f9ac501540d497cdea9a4d43e527, user_id=76615d678aed4857916590e9531a1d01, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:41.017528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b998d8-02e6-404e-82dd-530756e0980e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:41.037822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:41.041714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1061/2096] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:40 2022] PUT /identity/v3/projects/c2b3f9ac501540d497cdea9a4d43e527/users/76615d678aed4857916590e9531a1d01/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:41.530983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:42.198638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:42.392567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427905-a109-4a41-a8f4-9305b97a26b8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:42.393164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427905-a109-4a41-a8f4-9305b97a26b8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:42.393448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427905-a109-4a41-a8f4-9305b97a26b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:42.421179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-49427905-a109-4a41-a8f4-9305b97a26b8 None None] MFA Rules not processed for user `76615d678aed4857916590e9531a1d01`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:42.422411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-49427905-a109-4a41-a8f4-9305b97a26b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:42.494699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1036/2097] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:42.721860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:43.309514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb5fe-f887-4302-8633-222286bd78e1 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:43.309514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb5fe-f887-4302-8633-222286bd78e1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:43.309514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aeb5fe-f887-4302-8633-222286bd78e1 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:43.309514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1062/2098] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:51:43.310501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d101d-2bc2-413f-8649-e4719d090bf5 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:43.310849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d101d-2bc2-413f-8649-e4719d090bf5 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:43.311313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d101d-2bc2-413f-8649-e4719d090bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:43.348972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-da6d101d-2bc2-413f-8649-e4719d090bf5 None None] MFA Rules not processed for user `908320440dfe4e8783d77b7d385b43fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:43.351009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-da6d101d-2bc2-413f-8649-e4719d090bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:43.498328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1037/2099] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:51:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:43.565375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeb5fe-f887-4302-8633-222286bd78e1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:43.567365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-69aeb5fe-f887-4302-8633-222286bd78e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:43.594661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aeb5fe-f887-4302-8633-222286bd78e1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:43.601559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:43.602566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:43.609063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:43.609063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:43.613594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:43.615028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:43.627124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1063/2100] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:43.798693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:44.225616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d101d-2bc2-413f-8649-e4719d090bf5 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:44.291904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d101d-2bc2-413f-8649-e4719d090bf5 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:44.296660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:44.298038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:44.298405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:44.298686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] PATH_INFO: `/v3/users/9aae4371a13c4004a2b82755e5b8d4f2` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:44.300003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aae4371a13c4004a2b82755e5b8d4f2)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:44.302275 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:44.528442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aae4371a13c4004a2b82755e5b8d4f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:44.529091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aae4371a13c4004a2b82755e5b8d4f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:44.529698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aae4371a13c4004a2b82755e5b8d4f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:44.536766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aae4371a13c4004a2b82755e5b8d4f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:44.598521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aae4371a13c4004a2b82755e5b8d4f2'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:44.618696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1038/2101] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:44 2022] DELETE /identity/v3/users/9aae4371a13c4004a2b82755e5b8d4f2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:44.864761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:44.988138 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:45.007798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e0788-baef-4ad7-91db-f75861113638 service placement] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:45.074949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:45.075439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:45.075726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:45.076010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] PATH_INFO: `/v3/projects/c3e3f63e56534888b29d97b2ea5ff924` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:45.077216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e3f63e56534888b29d97b2ea5ff924)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:45.079135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:45.183719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e3f63e56534888b29d97b2ea5ff924', 'request_id': 'req-dbfa44bc-a747-4f19-98c8-5f51cefa5410'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.190029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e3f63e56534888b29d97b2ea5ff924', 'request_id': 'req-dbfa44bc-a747-4f19-98c8-5f51cefa5410'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.304024 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e3f63e56534888b29d97b2ea5ff924', 'request_id': 'req-dbfa44bc-a747-4f19-98c8-5f51cefa5410'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.316238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] The token cache is being invalidate because project c3e3f63e56534888b29d97b2ea5ff924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:45.316495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.317169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.321960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1064/2102] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:44 2022] DELETE /identity/v3/projects/c3e3f63e56534888b29d97b2ea5ff924 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:45.323133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:45.324683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:45.341313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c68dd4-8e59-4703-a585-8684af742711 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:45.399325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:45.399975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:45.400293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:45.400574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] PATH_INFO: `/v3/users/76615d678aed4857916590e9531a1d01` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:45.401740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=76615d678aed4857916590e9531a1d01)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:45.405865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:45.667521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76615d678aed4857916590e9531a1d01'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.668210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76615d678aed4857916590e9531a1d01'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.669095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76615d678aed4857916590e9531a1d01'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.677448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76615d678aed4857916590e9531a1d01'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.778128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-36239f7c-b554-4b0b-b654-398c08960e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76615d678aed4857916590e9531a1d01'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:45.796480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1039/2103] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:45 2022] DELETE /identity/v3/users/76615d678aed4857916590e9531a1d01 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:45.885115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:45.952873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:46.063833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:46.066001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:46.091235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa44bc-a747-4f19-98c8-5f51cefa5410 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:46.165497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:46.166221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:46.166512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:46.167041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] PATH_INFO: `/v3/projects/c2b3f9ac501540d497cdea9a4d43e527` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:46.168218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b3f9ac501540d497cdea9a4d43e527)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:46.170292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:46.374412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b3f9ac501540d497cdea9a4d43e527', 'request_id': 'req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:46.380849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b3f9ac501540d497cdea9a4d43e527', 'request_id': 'req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:46.493135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b3f9ac501540d497cdea9a4d43e527', 'request_id': 'req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:46.504576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] The token cache is being invalidate because project c2b3f9ac501540d497cdea9a4d43e527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:46.504875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:46.505635 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ceb65bdf-aeb4-4a79-8e6b-4b391d3bd2b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:46.507136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1065/2104] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:46 2022] DELETE /identity/v3/projects/c2b3f9ac501540d497cdea9a4d43e527 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:46.512183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df09a1-77f2-444e-8c13-b6f7cc945485 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:46.512723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df09a1-77f2-444e-8c13-b6f7cc945485 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:46.512827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df09a1-77f2-444e-8c13-b6f7cc945485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:46.532150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-49df09a1-77f2-444e-8c13-b6f7cc945485 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:46.533430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-49df09a1-77f2-444e-8c13-b6f7cc945485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:46.550252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:46.599166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1040/2105] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:46.608741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711e17-47ab-4180-8806-757a8fa9d3ff None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:46.611430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711e17-47ab-4180-8806-757a8fa9d3ff None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:46.611430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1711e17-47ab-4180-8806-757a8fa9d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:46.630530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b1711e17-47ab-4180-8806-757a8fa9d3ff None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:46.632421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b1711e17-47ab-4180-8806-757a8fa9d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:46.644146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1066/2106] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:46.645543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df09a1-77f2-444e-8c13-b6f7cc945485 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:46.657744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df09a1-77f2-444e-8c13-b6f7cc945485 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:46.663061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:46.666869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:46.667573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:46.667989 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:46.668375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:46.669380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:46.669900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:46.671900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:46.688110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1041/2107] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:46.689759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711e17-47ab-4180-8806-757a8fa9d3ff None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:46.699062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1711e17-47ab-4180-8806-757a8fa9d3ff None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:46.703748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:46.704384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:46.704663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:46.705190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:46.705943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:46.708416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:46.818185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1067/2108] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:46 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:46.822932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:46.839073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf057d-f4a0-487b-8340-b3db18467284 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:46.868046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:46.902036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:46.902663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:46.902951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:46.903233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:46.903870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:46.905830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.015258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1042/2109] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:46 2022] POST /identity/v3/users => generated 282 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:51:47.019295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.029852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6e8d6a-9955-47b1-921b-33b3f59d8749 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.034867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.035489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.035780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.036062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.036781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.038389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.049262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1068/2110] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:47.053230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.064045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda1b89-1158-4ee8-9f8d-eb67e87cb1d1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.068699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51421b41-fbed-4df5-8ef8-3f9797bd49c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.069294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51421b41-fbed-4df5-8ef8-3f9797bd49c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.069576 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51421b41-fbed-4df5-8ef8-3f9797bd49c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.069853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51421b41-fbed-4df5-8ef8-3f9797bd49c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.070495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51421b41-fbed-4df5-8ef8-3f9797bd49c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.072112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51421b41-fbed-4df5-8ef8-3f9797bd49c7 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.082641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1043/2111] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:47.089668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.100005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62212dda-a9a3-43de-9796-c6f0307e110b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.105452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.106122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.106442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.106874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] PATH_INFO: `/v3/projects/69db4dfdad4c4507ab93fcf231b057fd/users/30b358f029ec4510ba6340f49889edd9/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.123680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69db4dfdad4c4507ab93fcf231b057fd, user_id=30b358f029ec4510ba6340f49889edd9, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.126300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.212532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1069/2112] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:47 2022] PUT /identity/v3/projects/69db4dfdad4c4507ab93fcf231b057fd/users/30b358f029ec4510ba6340f49889edd9/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:47.215433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949782a-6cab-436f-99f8-2d381d7be278 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.216008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949782a-6cab-436f-99f8-2d381d7be278 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.216337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949782a-6cab-436f-99f8-2d381d7be278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.234212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:47.251326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c949782a-6cab-436f-99f8-2d381d7be278 None None] MFA Rules not processed for user `30b358f029ec4510ba6340f49889edd9`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:47.252593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c949782a-6cab-436f-99f8-2d381d7be278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:47.318429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1044/2113] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:47.322997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.383582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0de8f1-2cc6-453a-8b8b-0be6820f1f44 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.388254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.388861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.389144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.389423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.390054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.391956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.500559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1070/2114] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:47 2022] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:47.503911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949782a-6cab-436f-99f8-2d381d7be278 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.514473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949782a-6cab-436f-99f8-2d381d7be278 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.576511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.577302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.577525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.578154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.578632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.581423 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.687350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1045/2115] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:47 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:47.691319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.703557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aae26e-0ea3-48ee-8cf5-bfb5afa2fa93 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.709318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.709934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.710392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.711328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.712170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.714074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.735787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1071/2116] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:47.740097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.750263 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4ce03-86af-4d96-98d6-469d96640a9e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.754908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.755570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.755858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.756142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] PATH_INFO: `/v3/projects/6e9151ae18ab4737af2607db4544676f/users/f8548089b1724ba79eccdbd692007b4c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.772554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9151ae18ab4737af2607db4544676f, user_id=f8548089b1724ba79eccdbd692007b4c, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.775901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.845152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1046/2117] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:47 2022] PUT /identity/v3/projects/6e9151ae18ab4737af2607db4544676f/users/f8548089b1724ba79eccdbd692007b4c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:47.849240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.859229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26844762-07f3-4c35-822c-ca706181b347 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.863587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:47.915289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf666c-84dd-43e9-8446-e0197b2b58ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.915896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf666c-84dd-43e9-8446-e0197b2b58ee admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.916179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf666c-84dd-43e9-8446-e0197b2b58ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.916489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf666c-84dd-43e9-8446-e0197b2b58ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.917133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf666c-84dd-43e9-8446-e0197b2b58ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.918714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf666c-84dd-43e9-8446-e0197b2b58ee admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.932297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1072/2118] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:47.933639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:47.943797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2e980-9345-41e4-8dc5-af45136fc7ad admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:47.954548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:47.955484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.959554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.959554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] PATH_INFO: `/v3/projects/6e9151ae18ab4737af2607db4544676f/users/f8548089b1724ba79eccdbd692007b4c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:47.959554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e9151ae18ab4737af2607db4544676f, user_id=f8548089b1724ba79eccdbd692007b4c, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:47.960799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:47.973466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1047/2119] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:47 2022] PUT /identity/v3/projects/6e9151ae18ab4737af2607db4544676f/users/f8548089b1724ba79eccdbd692007b4c/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:47.978285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:47.983625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd634e-99ea-42d9-bdd8-861cbcb1b386 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:47.984123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd634e-99ea-42d9-bdd8-861cbcb1b386 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:47.989323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd634e-99ea-42d9-bdd8-861cbcb1b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:48.016661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-26cd634e-99ea-42d9-bdd8-861cbcb1b386 None None] MFA Rules not processed for user `f8548089b1724ba79eccdbd692007b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:48.017873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-26cd634e-99ea-42d9-bdd8-861cbcb1b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:48.072545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:48.095378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1073/2120] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:48.106748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:48.108530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:48.130126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:48.168001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437800d-08ec-4437-8982-71e373dbd698 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:48.171595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:48.172206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:48.172495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:48.172767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:48.182090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:48.184399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:48.192846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1048/2121] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:48.378671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:48.424027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd634e-99ea-42d9-bdd8-861cbcb1b386 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:48.430589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:48.434225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd634e-99ea-42d9-bdd8-861cbcb1b386 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:48.437861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8c868-9378-409e-b93c-2467ab215186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:48.438464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c868-9378-409e-b93c-2467ab215186 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:48.438749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c868-9378-409e-b93c-2467ab215186 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:48.439027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8c868-9378-409e-b93c-2467ab215186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:48.470275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:48.495855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8c868-9378-409e-b93c-2467ab215186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:48.497355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8c868-9378-409e-b93c-2467ab215186 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:48.506026 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1074/2122] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:48.767410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:48.875491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:49.109779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:49.435851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:49.606937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:50.102027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:50.251205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:50.432902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:50.681556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:51.001459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:52.165579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:52.186703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:52.230776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89862ef9-fc51-467d-8cc7-3c43c13d3c23 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:52.235665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:52.236352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:52.236665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:52.236949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] PATH_INFO: `/v3/users/30b358f029ec4510ba6340f49889edd9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:52.238107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b358f029ec4510ba6340f49889edd9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:52.240071 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:52.307815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147aed8-cbfa-456e-ae3d-192d2495947d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:52.308337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147aed8-cbfa-456e-ae3d-192d2495947d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:52.308449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147aed8-cbfa-456e-ae3d-192d2495947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:52.327253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a147aed8-cbfa-456e-ae3d-192d2495947d None None] MFA Rules not processed for user `e0a261a926d04a8bbda99b6a2154c010`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:52.328453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a147aed8-cbfa-456e-ae3d-192d2495947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:52.383573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1075/2123] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:52.471520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b358f029ec4510ba6340f49889edd9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:52.472288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b358f029ec4510ba6340f49889edd9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:52.472932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b358f029ec4510ba6340f49889edd9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:52.480389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b358f029ec4510ba6340f49889edd9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:52.535005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b358f029ec4510ba6340f49889edd9'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:52.552964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1049/2124] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:52 2022] DELETE /identity/v3/users/30b358f029ec4510ba6340f49889edd9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:52.557554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:52.557850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:52.558136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:52.579010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:52.580526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:52.614115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:52.645056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1076/2125] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:52.655079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:52.656524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:52.729748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97549a7-5020-40ad-a885-180ce1c34143 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:52.733290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:52.733901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:52.734182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:52.734456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:52.744053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:52.745518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:52.754829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1050/2126] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:53.215381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:53.216908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:53.237135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a5be6-23b1-4ced-ab02-988ff7301e7b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:53.243420 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:53.244347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:53.244823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:53.245228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] PATH_INFO: `/v3/projects/69db4dfdad4c4507ab93fcf231b057fd` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:53.246788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69db4dfdad4c4507ab93fcf231b057fd)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:53.248977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:53.394916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69db4dfdad4c4507ab93fcf231b057fd', 'request_id': 'req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.403099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69db4dfdad4c4507ab93fcf231b057fd', 'request_id': 'req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.474513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69db4dfdad4c4507ab93fcf231b057fd', 'request_id': 'req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.485681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] The token cache is being invalidate because project 69db4dfdad4c4507ab93fcf231b057fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:53.485979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.486613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.488112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1077/2127] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:53 2022] DELETE /identity/v3/projects/69db4dfdad4c4507ab93fcf231b057fd => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:53.492157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:53.502973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fecd2-0223-45b7-9452-e92fbab6197c service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:53.551794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:53.568290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:53.568924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:53.569205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:53.569574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] PATH_INFO: `/v3/users/f8548089b1724ba79eccdbd692007b4c` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:53.570704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8548089b1724ba79eccdbd692007b4c)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:53.573293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:53.727785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8548089b1724ba79eccdbd692007b4c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.728489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8548089b1724ba79eccdbd692007b4c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.729102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8548089b1724ba79eccdbd692007b4c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.736042 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8548089b1724ba79eccdbd692007b4c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.809680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-729a5ba5-386a-4ab5-8f97-77d052a3daf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8548089b1724ba79eccdbd692007b4c'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:53.828339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1051/2128] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:53 2022] DELETE /identity/v3/users/f8548089b1724ba79eccdbd692007b4c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:54.426301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:54.427905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:54.442382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa120d-4c0f-4b73-8b3f-a25eb769a202 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:54.503191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:54.503825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:54.504109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:54.504421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] PATH_INFO: `/v3/projects/6e9151ae18ab4737af2607db4544676f` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:54.505540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e9151ae18ab4737af2607db4544676f)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:54.507485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:54.619155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e9151ae18ab4737af2607db4544676f', 'request_id': 'req-ccf058bd-91c0-4a41-a070-90d504345d0a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:54.625368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e9151ae18ab4737af2607db4544676f', 'request_id': 'req-ccf058bd-91c0-4a41-a070-90d504345d0a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:54.629137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:54.700471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e9151ae18ab4737af2607db4544676f', 'request_id': 'req-ccf058bd-91c0-4a41-a070-90d504345d0a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:54.713070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] The token cache is being invalidate because project 6e9151ae18ab4737af2607db4544676f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:54.713586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:54.714260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ccf058bd-91c0-4a41-a070-90d504345d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:54.715806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1078/2129] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:54 2022] DELETE /identity/v3/projects/6e9151ae18ab4737af2607db4544676f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:54.720747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b7c0-f5cf-4dc8-b7eb-88fa8eaba237 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:54.721223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b7c0-f5cf-4dc8-b7eb-88fa8eaba237 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:54.721330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b7c0-f5cf-4dc8-b7eb-88fa8eaba237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:54.740964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-1075b7c0-f5cf-4dc8-b7eb-88fa8eaba237 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:54.742190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1075b7c0-f5cf-4dc8-b7eb-88fa8eaba237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:54.803229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1052/2130] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:54.812252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7b49-f947-4f9f-aad2-98f183aad51e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:54.812549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7b49-f947-4f9f-aad2-98f183aad51e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:54.812827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e7b49-f947-4f9f-aad2-98f183aad51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:54.832797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-706e7b49-f947-4f9f-aad2-98f183aad51e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:54.834007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-706e7b49-f947-4f9f-aad2-98f183aad51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:54.842674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1079/2131] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:54.851456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b7c0-f5cf-4dc8-b7eb-88fa8eaba237 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:54.861153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b7c0-f5cf-4dc8-b7eb-88fa8eaba237 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:54.865793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:54.866421 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:54.866706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:54.867006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:54.868178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:54.879714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:54.879714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:54.881875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1053/2132] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:54.887126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7b49-f947-4f9f-aad2-98f183aad51e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:54.896130 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e7b49-f947-4f9f-aad2-98f183aad51e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:54.900803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:54.901395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:54.901677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:54.901958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:54.902631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:54.904593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:54.974764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1080/2133] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:54 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:54.979084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:54.989816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709fc30-494d-4615-891a-5c3b9f27f0f5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.039622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:55.051569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.052186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.052498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.052778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.057691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.057691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:55.151527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1054/2134] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:54 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:55.151780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:55.169400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4654-6158-400d-8cd6-f6c79508ff07 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.174792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.175404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.175861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.176254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.180694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.180694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:55.190730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1081/2135] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:55.195317 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:55.207002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c78b64-4d58-45d8-a9e5-ce789cfa02d0 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.215487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff94b16-3e91-4bb4-b933-fd2d2313f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.216107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94b16-3e91-4bb4-b933-fd2d2313f37c admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.216424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94b16-3e91-4bb4-b933-fd2d2313f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.216704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94b16-3e91-4bb4-b933-fd2d2313f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.217355 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff94b16-3e91-4bb4-b933-fd2d2313f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.218944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff94b16-3e91-4bb4-b933-fd2d2313f37c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:55.231953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1055/2136] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:55.236733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:55.247630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc0749-aa1d-484a-960f-2c06b432f458 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.252375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.253031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.253310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.254841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] PATH_INFO: `/v3/projects/f035a4cee85944a29a5bf6536211722c/users/92bf4db4e501481d865aa9c58dcbd2a9/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.270210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f035a4cee85944a29a5bf6536211722c, user_id=92bf4db4e501481d865aa9c58dcbd2a9, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.271838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:55.375963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1082/2137] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:55 2022] PUT /identity/v3/projects/f035a4cee85944a29a5bf6536211722c/users/92bf4db4e501481d865aa9c58dcbd2a9/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:55.387352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc5b26-a6da-4b89-9cfe-165438c28f11 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.387735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc5b26-a6da-4b89-9cfe-165438c28f11 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.388369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc5b26-a6da-4b89-9cfe-165438c28f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.420623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2fbc5b26-a6da-4b89-9cfe-165438c28f11 None None] MFA Rules not processed for user `92bf4db4e501481d865aa9c58dcbd2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:55.421897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2fbc5b26-a6da-4b89-9cfe-165438c28f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:55.496017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1056/2138] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:55.501092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:55.571179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2caf5-a02e-4589-b1fc-88ef772ec4f6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.576241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.577009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.577295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.577604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.578274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.580478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:55.698270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1083/2139] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:55 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:55.702301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc5b26-a6da-4b89-9cfe-165438c28f11 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:55.713176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc5b26-a6da-4b89-9cfe-165438c28f11 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.775456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.776113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.776975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.776975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.777601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.779586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:55.906377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1057/2140] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:51:55 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:55.907479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:55.918345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c8fc1-3f3e-4a02-9be2-c7e07939095f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.924041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.924728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.925017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.925298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.925940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.927838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:55.955455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1084/2141] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:51:55.955706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:55.966769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e7972-8baf-4f86-ba1b-0c4425ee3f99 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:55.972468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:55.973137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:55.973419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:55.973730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] PATH_INFO: `/v3/projects/7b02da73332a43bdbdfe9e347d8702ae/users/0fff9bf67eba4b6380170cd3b6f3981d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:55.989790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b02da73332a43bdbdfe9e347d8702ae, user_id=0fff9bf67eba4b6380170cd3b6f3981d, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:55.992581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:56.072454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1058/2142] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:55 2022] PUT /identity/v3/projects/7b02da73332a43bdbdfe9e347d8702ae/users/0fff9bf67eba4b6380170cd3b6f3981d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:56.077533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:56.088272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c52b9-0cc0-4590-ace9-a9d69b434772 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:56.143225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:56.149093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a27b3-8610-4829-8382-774b75f12b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:56.149697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a27b3-8610-4829-8382-774b75f12b89 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:56.149981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a27b3-8610-4829-8382-774b75f12b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:56.150259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a27b3-8610-4829-8382-774b75f12b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:56.150902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a27b3-8610-4829-8382-774b75f12b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:56.152566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a27b3-8610-4829-8382-774b75f12b89 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:56.163253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1085/2143] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:51:56.167325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:56.178613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714826-5cba-42b2-bc58-87a4816eaad2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:56.186253 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:56.187319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:56.187429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:56.188010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] PATH_INFO: `/v3/projects/7b02da73332a43bdbdfe9e347d8702ae/users/0fff9bf67eba4b6380170cd3b6f3981d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:56.190092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b02da73332a43bdbdfe9e347d8702ae, user_id=0fff9bf67eba4b6380170cd3b6f3981d, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:56.192830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:56.204034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1059/2144] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:51:56 2022] PUT /identity/v3/projects/7b02da73332a43bdbdfe9e347d8702ae/users/0fff9bf67eba4b6380170cd3b6f3981d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:51:56.218662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4116c3-0ad6-4f5b-980e-ca72fd96660a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:56.218662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4116c3-0ad6-4f5b-980e-ca72fd96660a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:56.218662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4116c3-0ad6-4f5b-980e-ca72fd96660a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:56.283132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-6a4116c3-0ad6-4f5b-980e-ca72fd96660a None None] MFA Rules not processed for user `0fff9bf67eba4b6380170cd3b6f3981d`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:56.284607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6a4116c3-0ad6-4f5b-980e-ca72fd96660a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:56.358554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1086/2145] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:56.371665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:56.373400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:56.387575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:56.444616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73837d-d7f2-47e5-9e48-95807625ab07 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:56.448440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:56.449057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:56.449340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:56.449869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:56.459583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:56.462601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:56.473017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1060/2146] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:51:57.615551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4116c3-0ad6-4f5b-980e-ca72fd96660a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:57.626799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4116c3-0ad6-4f5b-980e-ca72fd96660a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:57.632161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fff9bf67eba4b6380170cd3b6f3981d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b02da73332a43bdbdfe9e347d8702ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:57.632948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:57.633256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:57.633539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:57.634377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:57.634719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:57.637055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:57.649753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1087/2147] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:51:57.654088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:57.663659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c90adf-a89a-4b01-8748-ce6694e572c2 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:57.670100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fff9bf67eba4b6380170cd3b6f3981d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b02da73332a43bdbdfe9e347d8702ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:57.670874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:57.671330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:57.671889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:57.673070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:57.675337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:57.808223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1061/2148] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:51:57 2022] POST /identity/v3/projects => generated 354 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:51:57.812488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:57.825738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1eaf2-af09-409d-ac9f-1f53074e2996 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:57.911160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61ceb0-6135-4ba9-98a6-66e7244d14a9 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fff9bf67eba4b6380170cd3b6f3981d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b02da73332a43bdbdfe9e347d8702ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:57.912220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ceb0-6135-4ba9-98a6-66e7244d14a9 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:57.913831 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ceb0-6135-4ba9-98a6-66e7244d14a9 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:57.926621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61ceb0-6135-4ba9-98a6-66e7244d14a9 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:57.928068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ceb0-6135-4ba9-98a6-66e7244d14a9 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:51:57.931920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ceb0-6135-4ba9-98a6-66e7244d14a9 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:57.933486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61ceb0-6135-4ba9-98a6-66e7244d14a9 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:57.970314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1088/2149] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:51:58.012482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:58.022865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7f5ca-981c-4e02-9acc-663c9eff2a6f tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:58.032484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fff9bf67eba4b6380170cd3b6f3981d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b02da73332a43bdbdfe9e347d8702ae', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:58.033179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:58.033471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:58.033772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] PATH_INFO: `/v3/projects/d90f6d2cbe234b2f8835f8735fa860ef` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:58.035076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d90f6d2cbe234b2f8835f8735fa860ef)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:58.037422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:58.037935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf388-03e0-4b99-926d-f9ba605df132 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:58.038360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf388-03e0-4b99-926d-f9ba605df132 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:58.038773 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bf388-03e0-4b99-926d-f9ba605df132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:58.065657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4f5bf388-03e0-4b99-926d-f9ba605df132 None None] MFA Rules not processed for user `d7d7577ea743410ca308f62b04e7cf58`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:58.065657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4f5bf388-03e0-4b99-926d-f9ba605df132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:58.123708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1089/2150] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:51:58.146687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90f6d2cbe234b2f8835f8735fa860ef', 'request_id': 'req-e53f6c8f-9daf-444b-9017-542265f7a3d5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:58.155767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90f6d2cbe234b2f8835f8735fa860ef', 'request_id': 'req-e53f6c8f-9daf-444b-9017-542265f7a3d5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:58.162102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90f6d2cbe234b2f8835f8735fa860ef', 'request_id': 'req-e53f6c8f-9daf-444b-9017-542265f7a3d5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:58.255667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] The token cache is being invalidate because project d90f6d2cbe234b2f8835f8735fa860ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:51:58.256079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:58.257047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e53f6c8f-9daf-444b-9017-542265f7a3d5 tempest-VolumeQuotaClassesTest-605117426 tempest-VolumeQuotaClassesTest-605117426-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:58.263230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1062/2151] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:51:58 2022] DELETE /identity/v3/projects/d90f6d2cbe234b2f8835f8735fa860ef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:58.994771 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf388-03e0-4b99-926d-f9ba605df132 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:59.001172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:59.063558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bf388-03e0-4b99-926d-f9ba605df132 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:59.124412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:59.125067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:59.125360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:59.125633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] PATH_INFO: `/v3/users/92bf4db4e501481d865aa9c58dcbd2a9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:59.126811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=92bf4db4e501481d865aa9c58dcbd2a9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:59.129550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:59.374981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92bf4db4e501481d865aa9c58dcbd2a9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:59.375645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92bf4db4e501481d865aa9c58dcbd2a9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:59.376382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92bf4db4e501481d865aa9c58dcbd2a9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:59.387981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92bf4db4e501481d865aa9c58dcbd2a9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:59.479018 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92bf4db4e501481d865aa9c58dcbd2a9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:51:59.492021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1090/2152] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:51:58 2022] DELETE /identity/v3/users/92bf4db4e501481d865aa9c58dcbd2a9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:51:59.496747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:59.497248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:59.497506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:59.517860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:51:59.519223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:59.592051 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1063/2153] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:51:59.603697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:51:59.605225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:51:59.652359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:51:59.684327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87079741-ff32-4810-af4f-72a137eb3acd admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:51:59.687890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:51:59.688587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:51:59.688865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:51:59.689140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:51:59.698346 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:51:59.699794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:51:59.713604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1091/2154] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:00.271753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:00.273490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:00.299476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee9452-ff64-4db9-aad4-27cf01ac39d4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:00.305519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:00.306332 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:00.306855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:00.307166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] PATH_INFO: `/v3/projects/f035a4cee85944a29a5bf6536211722c` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:00.308788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f035a4cee85944a29a5bf6536211722c)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:00.311115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:00.319864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:00.447619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f035a4cee85944a29a5bf6536211722c', 'request_id': 'req-c57877a4-f99b-428b-b9fc-81273955057d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.453856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f035a4cee85944a29a5bf6536211722c', 'request_id': 'req-c57877a4-f99b-428b-b9fc-81273955057d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.459916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f035a4cee85944a29a5bf6536211722c', 'request_id': 'req-c57877a4-f99b-428b-b9fc-81273955057d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.531441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] The token cache is being invalidate because project f035a4cee85944a29a5bf6536211722c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:00.532076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.532466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.534117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1064/2155] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:00 2022] DELETE /identity/v3/projects/f035a4cee85944a29a5bf6536211722c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:00.538331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:00.548679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001df43a-2ba6-4156-968d-b3cb9d7e5e2b service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:00.611678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:00.612355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:00.612953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:00.612953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] PATH_INFO: `/v3/users/0fff9bf67eba4b6380170cd3b6f3981d` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:00.614111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fff9bf67eba4b6380170cd3b6f3981d)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:00.616162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:00.811825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fff9bf67eba4b6380170cd3b6f3981d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.812762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fff9bf67eba4b6380170cd3b6f3981d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.813378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fff9bf67eba4b6380170cd3b6f3981d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.828471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fff9bf67eba4b6380170cd3b6f3981d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.920483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-140f10c5-9369-4bd6-976a-b4d7bb6e6b36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fff9bf67eba4b6380170cd3b6f3981d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:00.935761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1092/2156] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:00 2022] DELETE /identity/v3/users/0fff9bf67eba4b6380170cd3b6f3981d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:01.564927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:01.566481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:01.580756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57877a4-f99b-428b-b9fc-81273955057d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:01.644482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:01.645139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:01.645430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:01.645765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] PATH_INFO: `/v3/projects/7b02da73332a43bdbdfe9e347d8702ae` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:01.646940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b02da73332a43bdbdfe9e347d8702ae)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:01.648999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:01.769490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b02da73332a43bdbdfe9e347d8702ae', 'request_id': 'req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:01.776235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b02da73332a43bdbdfe9e347d8702ae', 'request_id': 'req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:01.781858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b02da73332a43bdbdfe9e347d8702ae', 'request_id': 'req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:01.865085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] The token cache is being invalidate because project 7b02da73332a43bdbdfe9e347d8702ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:01.865601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:01.866502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7d674087-bf4a-49a5-92b5-e0d17dd0e12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:01.868964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1065/2157] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:01 2022] DELETE /identity/v3/projects/7b02da73332a43bdbdfe9e347d8702ae => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:01.874612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0469f8-f9ed-4447-a87d-537dba612a5e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:01.875114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0469f8-f9ed-4447-a87d-537dba612a5e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:01.875192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0469f8-f9ed-4447-a87d-537dba612a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:01.896975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-7f0469f8-f9ed-4447-a87d-537dba612a5e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:01.898213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7f0469f8-f9ed-4447-a87d-537dba612a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:01.954791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:01.967533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1093/2158] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:01.975307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511782fd-0378-48e0-8a0a-430946a6935c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:01.975607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511782fd-0378-48e0-8a0a-430946a6935c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:01.975918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511782fd-0378-48e0-8a0a-430946a6935c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.000036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-511782fd-0378-48e0-8a0a-430946a6935c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:02.001912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-511782fd-0378-48e0-8a0a-430946a6935c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:02.012578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1066/2159] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:02.016985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0469f8-f9ed-4447-a87d-537dba612a5e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:02.027202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0469f8-f9ed-4447-a87d-537dba612a5e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:02.032446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:02.033258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.033572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.033946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.034853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:52:02.035374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:02.037105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:02.063590 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1094/2160] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:52:02.063746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511782fd-0378-48e0-8a0a-430946a6935c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:02.075618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511782fd-0378-48e0-8a0a-430946a6935c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:02.082214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:02.082853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.083138 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.083414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.084227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:02.086092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:02.170044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:02.184011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1067/2161] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:02 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:52:02.187992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:02.204238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256764c-e76e-4482-82c7-56cb5a801607 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:02.271788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:02.272464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.273220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.273627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.278338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:02.278338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:02.418480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1095/2162] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:02 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:02.428352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:02.458214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6f465-140e-4d18-8c26-73f129999692 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:02.465600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:02.467050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.467050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.467050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.467792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:02.470222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:02.484911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1068/2163] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:02.486419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:02.497179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd7320-6514-45b9-8032-2b1a74b93a43 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:02.505127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791476fb-be77-4ccf-bb30-c8cf21a16d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:02.505911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791476fb-be77-4ccf-bb30-c8cf21a16d91 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.506216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791476fb-be77-4ccf-bb30-c8cf21a16d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.506480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791476fb-be77-4ccf-bb30-c8cf21a16d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.507155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791476fb-be77-4ccf-bb30-c8cf21a16d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:02.509142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791476fb-be77-4ccf-bb30-c8cf21a16d91 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:02.521064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1096/2164] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:52:02.526200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:02.549100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86456f93-e037-4361-8140-575fe9cf33de admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:02.559811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:02.560414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.560794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.561274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] PATH_INFO: `/v3/projects/bafd354ebd214edcafb0a79f907b4449/users/e3c1a2486d84462a8dcf9a1807c3fe59/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.580088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bafd354ebd214edcafb0a79f907b4449, user_id=e3c1a2486d84462a8dcf9a1807c3fe59, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:02.582790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:02.668741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1069/2165] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:02 2022] PUT /identity/v3/projects/bafd354ebd214edcafb0a79f907b4449/users/e3c1a2486d84462a8dcf9a1807c3fe59/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:02.671508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa01af-861a-46cd-84c7-88e4414a6bdb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.671508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa01af-861a-46cd-84c7-88e4414a6bdb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.672475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa01af-861a-46cd-84c7-88e4414a6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.733148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8afa01af-861a-46cd-84c7-88e4414a6bdb None None] MFA Rules not processed for user `e3c1a2486d84462a8dcf9a1807c3fe59`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:02.736332 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8afa01af-861a-46cd-84c7-88e4414a6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:02.843988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1097/2166] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:02.858882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:02.957453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7da39-5726-415d-80c6-080aac593223 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:02.963493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:02.964515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:02.964728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:02.965013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:02.965959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:02.968035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:03.112178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1070/2167] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:02 2022] POST /identity/v3/projects => generated 387 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:03.113507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa01af-861a-46cd-84c7-88e4414a6bdb None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:03.125190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa01af-861a-46cd-84c7-88e4414a6bdb None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:03.172494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:03.185080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:03.185698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:03.185988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:03.186267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:03.186904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:03.188902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:03.410128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1098/2168] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:03 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:03.414256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:03.426943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddfd67a-e3c6-4e65-a846-deed4005626d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:03.432840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:03.433715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:03.433970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:03.434353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:03.435280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:03.437146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:03.449822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1071/2169] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:03.454198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:03.464561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9525c4e-164d-427f-b5c2-a5793baadaaf admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:03.469491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f89ed8-0f59-47f8-bc94-d218ce25aede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:03.470154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f89ed8-0f59-47f8-bc94-d218ce25aede admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:03.470661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f89ed8-0f59-47f8-bc94-d218ce25aede admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:03.471045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f89ed8-0f59-47f8-bc94-d218ce25aede admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:03.471806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f89ed8-0f59-47f8-bc94-d218ce25aede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:03.473703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f89ed8-0f59-47f8-bc94-d218ce25aede admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:03.489804 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1099/2170] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:03.495916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:03.505794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afd384-fad1-4abc-a824-48897d04c5df admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:03.510455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:03.511188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:03.511468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:03.511808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] PATH_INFO: `/v3/projects/525044be454a42eca80d96639d566162/users/5de25c71bcac4d1084990c83a330170f/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:03.526225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=525044be454a42eca80d96639d566162, user_id=5de25c71bcac4d1084990c83a330170f, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:03.528896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:03.610797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1072/2171] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:03 2022] PUT /identity/v3/projects/525044be454a42eca80d96639d566162/users/5de25c71bcac4d1084990c83a330170f/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:03.622867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0810504-ae4d-4c62-8084-be8cff414798 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:03.623260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0810504-ae4d-4c62-8084-be8cff414798 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:03.623531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0810504-ae4d-4c62-8084-be8cff414798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:03.650778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f0810504-ae4d-4c62-8084-be8cff414798 None None] MFA Rules not processed for user `5de25c71bcac4d1084990c83a330170f`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:03.651971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f0810504-ae4d-4c62-8084-be8cff414798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:03.712975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1100/2172] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:03.717542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:03.791903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5e3cf-b87e-4a8c-a51c-de26b19e6f4b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:03.797121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:03.798735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:03.799192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:03.799759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:03.801606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:03.805438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:03.931752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:03.945422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1073/2173] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:03 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:03.949506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0810504-ae4d-4c62-8084-be8cff414798 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:03.964087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0810504-ae4d-4c62-8084-be8cff414798 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:04.019906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:04.020550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:04.020830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:04.021127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:04.021759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:04.024220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:04.120242 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1101/2174] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:03 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:04.122277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:04.132465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999d876-0d5c-49b2-b60e-ff47d5cc8295 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:04.137107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:04.137699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:04.137983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:04.138260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:04.138914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:04.140591 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:04.151443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1074/2175] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:04.158373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:04.169192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39adaa-5067-4875-a3a2-6816ddeca095 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:04.173982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:04.174698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:04.175200 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:04.176403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] PATH_INFO: `/v3/projects/c54fa5622b3c4cbe8a5240cea4fce909/users/138fc52bace54442b7d4963504ddff0a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:04.191094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54fa5622b3c4cbe8a5240cea4fce909, user_id=138fc52bace54442b7d4963504ddff0a, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:04.193923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:04.292740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1102/2176] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:04 2022] PUT /identity/v3/projects/c54fa5622b3c4cbe8a5240cea4fce909/users/138fc52bace54442b7d4963504ddff0a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:04.297654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:04.307070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93914665-07dd-41c1-806d-7be0c41e0113 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:04.364982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199766b4-d16f-4819-9fdb-807ff3b3cf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:04.365668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199766b4-d16f-4819-9fdb-807ff3b3cf32 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:04.365960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199766b4-d16f-4819-9fdb-807ff3b3cf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:04.366242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199766b4-d16f-4819-9fdb-807ff3b3cf32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:04.366998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199766b4-d16f-4819-9fdb-807ff3b3cf32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:04.368677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199766b4-d16f-4819-9fdb-807ff3b3cf32 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:04.379306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1075/2177] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:04.384175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:04.395060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a00c9-7042-43f9-9c3c-c915938296c8 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:04.400386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:04.401043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:04.401324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:04.401633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] PATH_INFO: `/v3/projects/c54fa5622b3c4cbe8a5240cea4fce909/users/138fc52bace54442b7d4963504ddff0a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:04.403738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54fa5622b3c4cbe8a5240cea4fce909, user_id=138fc52bace54442b7d4963504ddff0a, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:04.406390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:04.417410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1103/2178] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:04 2022] PUT /identity/v3/projects/c54fa5622b3c4cbe8a5240cea4fce909/users/138fc52bace54442b7d4963504ddff0a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:52:04.427898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4974de-bc32-4cb8-92ae-6e1585ced58c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:04.428227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4974de-bc32-4cb8-92ae-6e1585ced58c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:04.428551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4974de-bc32-4cb8-92ae-6e1585ced58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:04.457281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3b4974de-bc32-4cb8-92ae-6e1585ced58c None None] MFA Rules not processed for user `138fc52bace54442b7d4963504ddff0a`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:04.458575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3b4974de-bc32-4cb8-92ae-6e1585ced58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:04.541773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1076/2179] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:04.550460 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:04.552266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:04.564181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:04.618172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70589c-2c98-420b-b489-a250fb0fa343 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:04.622334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:04.622955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:04.623242 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:04.623588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:04.633712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:04.635205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:04.645589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1104/2180] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:05.787267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4974de-bc32-4cb8-92ae-6e1585ced58c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:05.799841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4974de-bc32-4cb8-92ae-6e1585ced58c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:05.806797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8c6c0-24a1-438d-bbb3-e6d6eeccc388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:05.807866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8c6c0-24a1-438d-bbb3-e6d6eeccc388 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:05.808773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8c6c0-24a1-438d-bbb3-e6d6eeccc388 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:05.809311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8c6c0-24a1-438d-bbb3-e6d6eeccc388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:05.885705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8c6c0-24a1-438d-bbb3-e6d6eeccc388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:05.887268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8c6c0-24a1-438d-bbb3-e6d6eeccc388 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:05.897301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1077/2181] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:07.803713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:07.805670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:07.872512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6011f0c3-8fc8-47b9-9780-1cf57baceeea service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:07.877176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:07.877808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:07.878095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:07.878378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] PATH_INFO: `/v3/users/40065b00882f45e38206aa56847efbd5` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:07.879521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40065b00882f45e38206aa56847efbd5)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:07.881477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:08.096731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40065b00882f45e38206aa56847efbd5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:08.097390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40065b00882f45e38206aa56847efbd5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:08.098003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40065b00882f45e38206aa56847efbd5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:08.110878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40065b00882f45e38206aa56847efbd5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:08.174224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40065b00882f45e38206aa56847efbd5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:08.187813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1105/2182] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:07 2022] DELETE /identity/v3/users/40065b00882f45e38206aa56847efbd5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:08.192733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:08.193231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:08.193344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:08.207084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:08.212994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:08.214212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:08.275199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1078/2183] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:08.286469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:08.293434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:08.334732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:08.360486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363f5e8-0a07-493b-9a90-8074a8a3d39d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:08.364540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:08.365147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:08.365419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:08.365695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:08.375232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:08.377222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:08.386731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1106/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:08.927450 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:08.929117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:08.953177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a5a4d-e435-4e6b-9aeb-6608f4c22ced None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:08.964759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:08.965855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:08.966152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:08.966575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] PATH_INFO: `/v3/projects/e8d068217678468c831713b9f67e756d` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:08.972540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8d068217678468c831713b9f67e756d)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:08.974604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:09.101188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8d068217678468c831713b9f67e756d', 'request_id': 'req-847c0ae5-395f-4713-855e-d12d098e3869'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:09.107640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8d068217678468c831713b9f67e756d', 'request_id': 'req-847c0ae5-395f-4713-855e-d12d098e3869'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:09.113523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8d068217678468c831713b9f67e756d', 'request_id': 'req-847c0ae5-395f-4713-855e-d12d098e3869'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:09.200394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] The token cache is being invalidate because project e8d068217678468c831713b9f67e756d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:09.200963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:09.201504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-847c0ae5-395f-4713-855e-d12d098e3869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:09.203192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1079/2185] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:08 2022] DELETE /identity/v3/projects/e8d068217678468c831713b9f67e756d => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:11.030655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:11.032233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:11.116128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7634c2-a3a8-4036-a3a1-2015748cfa9c service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:11.213714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:11.214525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:11.214807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:11.215183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:11.217403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:11.283932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:11.285415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:11.295933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1107/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:14.987915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f004e-e06b-4e5d-b298-eacd0640ef44 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:14.988493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f004e-e06b-4e5d-b298-eacd0640ef44 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:14.988588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f004e-e06b-4e5d-b298-eacd0640ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:15.009392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-961f004e-e06b-4e5d-b298-eacd0640ef44 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:15.010596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-961f004e-e06b-4e5d-b298-eacd0640ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:15.076354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1080/2187] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:15.102541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:15.104958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:15.166856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:15.197272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167e2d2-824b-43f0-82e9-f3595e606fd1 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:15.205173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:15.205173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:15.205173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:15.206228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:15.215811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:15.217751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:15.229825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1108/2188] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:15.331907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:15.332222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:15.332517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:15.352490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:15.359454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:15.380794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:15.410011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1081/2189] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:52:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:15.452838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:15.454544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:15.532144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ef991-d05b-4b47-a661-dcefbb5edff3 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:15.538535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfdfea-9c6b-4e29-8d6a-9df6bffcc535 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:15.539378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfdfea-9c6b-4e29-8d6a-9df6bffcc535 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:15.539790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfdfea-9c6b-4e29-8d6a-9df6bffcc535 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:15.540271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfdfea-9c6b-4e29-8d6a-9df6bffcc535 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:15.550617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfdfea-9c6b-4e29-8d6a-9df6bffcc535 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:15.552680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfdfea-9c6b-4e29-8d6a-9df6bffcc535 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:15.582390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1109/2190] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:52:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:52:15.646172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:15.651120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:15.677396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db6605-e94c-4330-aa57-ff3c30a6424e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:15.686992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:15.687657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:15.687947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:15.688744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] PATH_INFO: `/v3/users/e3c1a2486d84462a8dcf9a1807c3fe59` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:15.690509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3c1a2486d84462a8dcf9a1807c3fe59)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:15.693642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:15.920717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3c1a2486d84462a8dcf9a1807c3fe59'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:15.921567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3c1a2486d84462a8dcf9a1807c3fe59'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:15.922336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3c1a2486d84462a8dcf9a1807c3fe59'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:15.950976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3c1a2486d84462a8dcf9a1807c3fe59'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:16.059758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3c1a2486d84462a8dcf9a1807c3fe59'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:16.097283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:16.097892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:16.098413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:16.101291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1082/2191] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:15 2022] DELETE /identity/v3/users/e3c1a2486d84462a8dcf9a1807c3fe59 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:16.130953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:16.133014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:16.376941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1110/2192] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:16.388767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:16.392010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:16.489449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0388d2-829a-4cb9-aece-ea631ea4efb6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:16.496023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:16.497265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:16.498058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:16.498496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:16.511257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:16.512920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:16.526950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1083/2193] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:17.224716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:17.226802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:17.254595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ed3ce-669e-4ed5-a9b1-97d7d5cf5c81 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:17.261615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:17.262759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:17.263402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:17.264008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] PATH_INFO: `/v3/projects/bafd354ebd214edcafb0a79f907b4449` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:17.265548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bafd354ebd214edcafb0a79f907b4449)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:17.267664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:17.407417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bafd354ebd214edcafb0a79f907b4449', 'request_id': 'req-fce089b3-78a2-45ba-ac8d-cf4fb059333a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.432910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bafd354ebd214edcafb0a79f907b4449', 'request_id': 'req-fce089b3-78a2-45ba-ac8d-cf4fb059333a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.438783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:17.571409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bafd354ebd214edcafb0a79f907b4449', 'request_id': 'req-fce089b3-78a2-45ba-ac8d-cf4fb059333a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.590122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] The token cache is being invalidate because project bafd354ebd214edcafb0a79f907b4449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:17.590605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.593125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.597999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1111/2194] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:17 2022] DELETE /identity/v3/projects/bafd354ebd214edcafb0a79f907b4449 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:17.599277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:17.642508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75ef8b-489c-4041-a4ad-5d0d34b20019 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:17.737720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:17.751871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:17.754572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:17.754733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:17.754965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] PATH_INFO: `/v3/users/5de25c71bcac4d1084990c83a330170f` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:17.761136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de25c71bcac4d1084990c83a330170f)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:17.768774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:17.987851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de25c71bcac4d1084990c83a330170f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.988540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de25c71bcac4d1084990c83a330170f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.989153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de25c71bcac4d1084990c83a330170f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:17.998842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de25c71bcac4d1084990c83a330170f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:18.065232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de25c71bcac4d1084990c83a330170f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:18.098943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1084/2195] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:17 2022] DELETE /identity/v3/users/5de25c71bcac4d1084990c83a330170f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:18.935157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:18.937283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:18.961499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce089b3-78a2-45ba-ac8d-cf4fb059333a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:19.065135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:19.065135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:19.065135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:19.065535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] PATH_INFO: `/v3/projects/525044be454a42eca80d96639d566162` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:19.067786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=525044be454a42eca80d96639d566162)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:19.070900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:19.190731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525044be454a42eca80d96639d566162', 'request_id': 'req-4309d388-a7e5-454a-84f3-b5afdb8e4c28'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.200345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525044be454a42eca80d96639d566162', 'request_id': 'req-4309d388-a7e5-454a-84f3-b5afdb8e4c28'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.283091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525044be454a42eca80d96639d566162', 'request_id': 'req-4309d388-a7e5-454a-84f3-b5afdb8e4c28'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.308364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] The token cache is being invalidate because project 525044be454a42eca80d96639d566162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:19.309307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.310405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.312513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1112/2196] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:18 2022] DELETE /identity/v3/projects/525044be454a42eca80d96639d566162 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:19.316180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:19.321309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:19.371609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d0a24-7bfb-43d9-b5b9-249c14352ed5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:19.528891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:19.529740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:19.530093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:19.530514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] PATH_INFO: `/v3/users/138fc52bace54442b7d4963504ddff0a` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:19.531777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=138fc52bace54442b7d4963504ddff0a)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:19.535048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:19.753155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138fc52bace54442b7d4963504ddff0a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.753821 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138fc52bace54442b7d4963504ddff0a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.754424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138fc52bace54442b7d4963504ddff0a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.761404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138fc52bace54442b7d4963504ddff0a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.839337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-815ed0a8-edcf-41a9-afc7-cb7d9971d78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138fc52bace54442b7d4963504ddff0a'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:19.847949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:19.867177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1085/2197] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:19 2022] DELETE /identity/v3/users/138fc52bace54442b7d4963504ddff0a => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:20.395764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:20.397228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:20.412298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309d388-a7e5-454a-84f3-b5afdb8e4c28 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:20.550936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:20.551848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:20.552476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:20.552910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] PATH_INFO: `/v3/projects/c54fa5622b3c4cbe8a5240cea4fce909` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:20.554317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54fa5622b3c4cbe8a5240cea4fce909)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:20.558476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:20.581205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:20.722703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54fa5622b3c4cbe8a5240cea4fce909', 'request_id': 'req-2eac6009-d426-4e10-a055-3be5d1cdeeec'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:20.729339 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54fa5622b3c4cbe8a5240cea4fce909', 'request_id': 'req-2eac6009-d426-4e10-a055-3be5d1cdeeec'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:20.848476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54fa5622b3c4cbe8a5240cea4fce909', 'request_id': 'req-2eac6009-d426-4e10-a055-3be5d1cdeeec'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:20.867269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] The token cache is being invalidate because project c54fa5622b3c4cbe8a5240cea4fce909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:20.867632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:20.870408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2eac6009-d426-4e10-a055-3be5d1cdeeec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:20.872317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1113/2198] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:20 2022] DELETE /identity/v3/projects/c54fa5622b3c4cbe8a5240cea4fce909 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:20.880667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ab16a-e9dd-4e83-a47f-a713ab8af28b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:20.881294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ab16a-e9dd-4e83-a47f-a713ab8af28b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:20.881971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ab16a-e9dd-4e83-a47f-a713ab8af28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:20.912495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ad3ab16a-e9dd-4e83-a47f-a713ab8af28b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:20.913871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ad3ab16a-e9dd-4e83-a47f-a713ab8af28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:20.981579 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1086/2199] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:20.991462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff250f-88f4-4dbc-9bf8-31467c869245 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:20.991751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff250f-88f4-4dbc-9bf8-31467c869245 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:20.992034 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff250f-88f4-4dbc-9bf8-31467c869245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.021708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-75ff250f-88f4-4dbc-9bf8-31467c869245 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:21.021708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-75ff250f-88f4-4dbc-9bf8-31467c869245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:21.031685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1114/2200] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:21.036396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ab16a-e9dd-4e83-a47f-a713ab8af28b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.049348 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ab16a-e9dd-4e83-a47f-a713ab8af28b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:21.057829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:21.058572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.058942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.059386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.062103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:52:21.062103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:21.062103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:21.084181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1087/2201] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:52:21.085699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff250f-88f4-4dbc-9bf8-31467c869245 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.104987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff250f-88f4-4dbc-9bf8-31467c869245 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:21.125792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:21.126437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.126722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.127000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.128936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:21.134295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:21.232957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1115/2202] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:21 2022] POST /identity/v3/projects => generated 361 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:21.238519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.255360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba3a70-df55-411b-8399-1d67160150f2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:21.346717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:21.347459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.347802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.348205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.349285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:21.351594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:21.456842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1088/2203] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:21 2022] POST /identity/v3/users => generated 281 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:21.461207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.476983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d8814-e909-4980-99a9-717cfe16daa9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:21.487469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:21.488145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.489114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.489679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.490441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:21.492774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:21.516907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1116/2204] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:21.518105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.531524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed716cc9-4dcd-4f85-94da-55b363d46199 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:21.549288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef4f42-1982-4292-a8c6-22b698d8edf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:21.549288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4f42-1982-4292-a8c6-22b698d8edf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.549288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4f42-1982-4292-a8c6-22b698d8edf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.549288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef4f42-1982-4292-a8c6-22b698d8edf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.549663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef4f42-1982-4292-a8c6-22b698d8edf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:21.549663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef4f42-1982-4292-a8c6-22b698d8edf7 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:21.559467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1089/2205] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:21.560819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.573428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7ee21-200e-4567-9c44-da47f77ebb5c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:21.581777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe5736-5a22-42fe-9e72-e1bec647f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:21.586366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5736-5a22-42fe-9e72-e1bec647f2cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.586366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5736-5a22-42fe-9e72-e1bec647f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.586366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe5736-5a22-42fe-9e72-e1bec647f2cc admin admin] PATH_INFO: `/v3/projects/c69b2d2e5c9c4838966faf4ceae6e5fd/users/3f18e239f434403a81969c061d8adedd/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.589796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.590489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.590876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.612682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe5736-5a22-42fe-9e72-e1bec647f2cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69b2d2e5c9c4838966faf4ceae6e5fd, user_id=3f18e239f434403a81969c061d8adedd, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:21.616049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe5736-5a22-42fe-9e72-e1bec647f2cc admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:21.623872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:21.625418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:21.636826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1090/2206] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:21.652823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.654420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:21.708291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1117/2207] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:21 2022] PUT /identity/v3/projects/c69b2d2e5c9c4838966faf4ceae6e5fd/users/3f18e239f434403a81969c061d8adedd/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:21.712462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.712973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.713406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:21.751100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:21.763906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] MFA Rules not processed for user `3f18e239f434403a81969c061d8adedd`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:21.766113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:21.785595 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c878f89-7b6b-46b0-8173-9cebec714fd8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:21.889867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1118/2208] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:21.927021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:21.928907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:21.940864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:21.941590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:21.941952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:21.942224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:22.012947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:22.062668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2dbd3-856f-461f-824e-004d674b9b13 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:22.069470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fec40-0c21-4408-9caa-2fea2133acc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:22.070743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fec40-0c21-4408-9caa-2fea2133acc3 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:22.071271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fec40-0c21-4408-9caa-2fea2133acc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:22.071738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fec40-0c21-4408-9caa-2fea2133acc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:22.081938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:22.084769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:22.101536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fec40-0c21-4408-9caa-2fea2133acc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:22.101785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1091/2209] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:22.104365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fec40-0c21-4408-9caa-2fea2133acc3 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:22.117454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1119/2210] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:22.136044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:22.157387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a2b39-f6c6-47b6-bf23-3d29a3bf39c7 service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:22.169366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:22.170026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:22.170314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:22.170593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] PATH_INFO: `/v3/users/3f18e239f434403a81969c061d8adedd` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:22.178837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f18e239f434403a81969c061d8adedd)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:22.178837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:22.400175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f18e239f434403a81969c061d8adedd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:22.400885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f18e239f434403a81969c061d8adedd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:22.401504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f18e239f434403a81969c061d8adedd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:22.412227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f18e239f434403a81969c061d8adedd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:22.490937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f18e239f434403a81969c061d8adedd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:22.514888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:22.532671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1092/2211] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:22 2022] DELETE /identity/v3/users/3f18e239f434403a81969c061d8adedd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:52:22.537219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:22.538772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:22.539287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:22.560101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:22.561292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:22.674384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1120/2212] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:22.675628 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:22.677115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:22.750462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861743-1114-4a54-a226-7f7ea23ab19d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:22.756038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15f5f8-fc33-41ae-9166-7235e2c0a18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:22.756693 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f5f8-fc33-41ae-9166-7235e2c0a18d service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:22.756980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f5f8-fc33-41ae-9166-7235e2c0a18d service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:22.757258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15f5f8-fc33-41ae-9166-7235e2c0a18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:22.776776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f5f8-fc33-41ae-9166-7235e2c0a18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:22.779262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15f5f8-fc33-41ae-9166-7235e2c0a18d service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:22.800022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1093/2213] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:23.404767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:23.406172 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:23.420712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883eccb-32b9-4049-83a6-6387dcf85cc8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:23.426705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:23.427351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:23.427639 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:23.427922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] PATH_INFO: `/v3/projects/c69b2d2e5c9c4838966faf4ceae6e5fd` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:23.429078 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69b2d2e5c9c4838966faf4ceae6e5fd)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:23.431510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:23.559553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69b2d2e5c9c4838966faf4ceae6e5fd', 'request_id': 'req-6e343d95-ea6c-4caa-9b33-8288cebdd250'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:23.567653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69b2d2e5c9c4838966faf4ceae6e5fd', 'request_id': 'req-6e343d95-ea6c-4caa-9b33-8288cebdd250'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:23.631736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69b2d2e5c9c4838966faf4ceae6e5fd', 'request_id': 'req-6e343d95-ea6c-4caa-9b33-8288cebdd250'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:23.646366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] The token cache is being invalidate because project c69b2d2e5c9c4838966faf4ceae6e5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:23.646810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:23.647556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6e343d95-ea6c-4caa-9b33-8288cebdd250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:23.650296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1121/2214] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:23 2022] DELETE /identity/v3/projects/c69b2d2e5c9c4838966faf4ceae6e5fd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:23.655451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f638d-002c-4ebe-baed-83ba09c5f2b8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:23.656257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f638d-002c-4ebe-baed-83ba09c5f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:23.656257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f638d-002c-4ebe-baed-83ba09c5f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:23.679878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6a0f638d-002c-4ebe-baed-83ba09c5f2b8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:23.681302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6a0f638d-002c-4ebe-baed-83ba09c5f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:23.797225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1094/2215] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:23.803446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87b27a-66b4-41c4-81e3-2dadffbd0f59 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:23.807185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87b27a-66b4-41c4-81e3-2dadffbd0f59 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:23.807499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af87b27a-66b4-41c4-81e3-2dadffbd0f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:23.853579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-af87b27a-66b4-41c4-81e3-2dadffbd0f59 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:23.856435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-af87b27a-66b4-41c4-81e3-2dadffbd0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:23.898963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1122/2216] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:23.904241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f638d-002c-4ebe-baed-83ba09c5f2b8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:23.918620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f638d-002c-4ebe-baed-83ba09c5f2b8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:23.925267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:23.925999 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:23.926296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:23.926578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:23.927360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:52:23.927683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:23.929506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:23.949750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1095/2217] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:52:23.954782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87b27a-66b4-41c4-81e3-2dadffbd0f59 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:23.965405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af87b27a-66b4-41c4-81e3-2dadffbd0f59 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:23.971778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:23.972623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:23.973018 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:23.973381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:23.974029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:23.976558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:24.059391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1123/2218] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:23 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:24.064330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:24.076389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39084c4a-480f-446e-bf7d-3384571c85cc admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:24.151404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:24.152114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:24.152452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:24.152729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:24.153361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:24.155270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:24.248228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1096/2219] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:24 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:52:24.249939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:24.261666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea04e5-1fbb-4908-9232-b255a8d725d6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:24.267173 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:24.267925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:24.268941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:24.269300 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:24.270046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:24.271762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:24.284577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1124/2220] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:24.289923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:24.303467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67143548-8612-44ff-bfd1-d83e7502c943 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:24.308676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6770930-ace5-4ea8-8ec1-e662b54d1267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:24.309288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770930-ace5-4ea8-8ec1-e662b54d1267 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:24.309574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770930-ace5-4ea8-8ec1-e662b54d1267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:24.309901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6770930-ace5-4ea8-8ec1-e662b54d1267 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:24.310669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6770930-ace5-4ea8-8ec1-e662b54d1267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:24.312418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6770930-ace5-4ea8-8ec1-e662b54d1267 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:24.327717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:24.340567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1097/2221] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:24.342796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:24.355286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9e6b7-2d28-4e9b-8b4d-d6a037519fd5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:24.360007 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:24.360743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:24.361132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:24.361674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] PATH_INFO: `/v3/projects/912efeffe45b4f79b317f13a5270752b/users/8c1235e6249b4767808d44cc324dc284/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:24.378422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:24.383860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=912efeffe45b4f79b317f13a5270752b, user_id=8c1235e6249b4767808d44cc324dc284, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:24.385135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:24.464155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1125/2222] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:24 2022] PUT /identity/v3/projects/912efeffe45b4f79b317f13a5270752b/users/8c1235e6249b4767808d44cc324dc284/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:24.475938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0ef4d-31e4-43dc-bfdd-eef09988d32d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:24.476364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0ef4d-31e4-43dc-bfdd-eef09988d32d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:24.476549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0ef4d-31e4-43dc-bfdd-eef09988d32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:24.510655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ebe0ef4d-31e4-43dc-bfdd-eef09988d32d None None] MFA Rules not processed for user `8c1235e6249b4767808d44cc324dc284`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:24.512255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ebe0ef4d-31e4-43dc-bfdd-eef09988d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:24.585169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1098/2223] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:24.600556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:24.603237 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:24.664371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a08921-1dc5-4fca-ba68-d592827bb35c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:24.668814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05aa8e-65c9-422f-b626-030d0e6967c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:24.671918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05aa8e-65c9-422f-b626-030d0e6967c8 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:24.671918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05aa8e-65c9-422f-b626-030d0e6967c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:24.671918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05aa8e-65c9-422f-b626-030d0e6967c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:24.679325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05aa8e-65c9-422f-b626-030d0e6967c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:24.681547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05aa8e-65c9-422f-b626-030d0e6967c8 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:24.692081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1126/2224] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:28.006566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0ef4d-31e4-43dc-bfdd-eef09988d32d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:28.101652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe0ef4d-31e4-43dc-bfdd-eef09988d32d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:28.106741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:28.107612 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:28.107959 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:28.108333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] PATH_INFO: `/v3/users/8c1235e6249b4767808d44cc324dc284` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:28.109557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c1235e6249b4767808d44cc324dc284)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:28.111565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:28.325342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c1235e6249b4767808d44cc324dc284'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:28.326698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c1235e6249b4767808d44cc324dc284'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:28.327600 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c1235e6249b4767808d44cc324dc284'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:28.343739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c1235e6249b4767808d44cc324dc284'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:28.422363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:28.423205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:28.423205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:28.444175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:28.445613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:28.454833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1127/2225] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:28.470655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:28.472076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:28.473843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1b457b5a-40a1-449d-be54-6ad83f148236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c1235e6249b4767808d44cc324dc284'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:28.510428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1099/2226] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:28 2022] DELETE /identity/v3/users/8c1235e6249b4767808d44cc324dc284 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:28.515915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:28.519181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:28.520869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:28.558996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:28.561012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:28.566379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:28.615455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a66de1-4047-4a1f-a048-2769b0f017d9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:28.678381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1100/2227] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:28.680304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:28.690765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:28.717019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:28.718967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:28.720955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:28.721463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:28.743628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:28.745405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:28.762028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1128/2228] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:28.818023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263a8dc-e86f-4d26-94ce-42cdbd5a4a66 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:28.824533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c376d2-5b47-44f2-a500-b5a77ece35d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:28.825490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c376d2-5b47-44f2-a500-b5a77ece35d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:28.825852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c376d2-5b47-44f2-a500-b5a77ece35d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:28.826327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c376d2-5b47-44f2-a500-b5a77ece35d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:28.849459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c376d2-5b47-44f2-a500-b5a77ece35d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:28.852614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c376d2-5b47-44f2-a500-b5a77ece35d6 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:28.879772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1101/2229] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:29.587371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:29.588890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:29.609198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53148b5-fec5-47c7-b362-c351a83e50ba service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:29.614386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:29.617241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:29.617241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:29.617241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] PATH_INFO: `/v3/projects/912efeffe45b4f79b317f13a5270752b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:29.617241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=912efeffe45b4f79b317f13a5270752b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:29.620439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:29.628968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:29.772546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '912efeffe45b4f79b317f13a5270752b', 'request_id': 'req-dfa8afef-8a18-432f-a077-f6989594d763'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:29.781687 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '912efeffe45b4f79b317f13a5270752b', 'request_id': 'req-dfa8afef-8a18-432f-a077-f6989594d763'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:29.872930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '912efeffe45b4f79b317f13a5270752b', 'request_id': 'req-dfa8afef-8a18-432f-a077-f6989594d763'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:29.887304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] The token cache is being invalidate because project 912efeffe45b4f79b317f13a5270752b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:29.887606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:29.888465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-dfa8afef-8a18-432f-a077-f6989594d763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:29.890039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1129/2230] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:29 2022] DELETE /identity/v3/projects/912efeffe45b4f79b317f13a5270752b => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:29.899755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacbb8-59d2-4447-80d3-83a2fbaab3c1 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:29.900494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacbb8-59d2-4447-80d3-83a2fbaab3c1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:29.900494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacbb8-59d2-4447-80d3-83a2fbaab3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:29.935863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e9bacbb8-59d2-4447-80d3-83a2fbaab3c1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:29.939558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e9bacbb8-59d2-4447-80d3-83a2fbaab3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:30.053803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1102/2231] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:30.064923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bf6d-8ff0-4444-944c-4047c664cefc None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.065216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bf6d-8ff0-4444-944c-4047c664cefc None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.065532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0bf6d-8ff0-4444-944c-4047c664cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.088589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-abc0bf6d-8ff0-4444-944c-4047c664cefc None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:30.090054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-abc0bf6d-8ff0-4444-944c-4047c664cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:30.099477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1130/2232] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:30.103964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bacbb8-59d2-4447-80d3-83a2fbaab3c1 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:30.113852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bacbb8-59d2-4447-80d3-83a2fbaab3c1 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:30.119424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:30.120048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.120364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.120648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.121311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:52:30.121623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:30.123221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:30.137220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1103/2233] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:52:30.159497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bf6d-8ff0-4444-944c-4047c664cefc None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:30.169620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0bf6d-8ff0-4444-944c-4047c664cefc None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:30.176892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:30.177508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.177854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.178138 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.178816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:30.181377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:30.509399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1131/2234] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:30 2022] POST /identity/v3/projects => generated 375 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:30.513904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:30.523963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c314-2ef0-45d0-b20a-7c629dad50a4 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:30.571050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:30.600065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:30.600802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.601086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.601366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.602521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:30.604524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:30.689828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1104/2235] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:30 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:30.693905 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:30.705575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56fab6-08bb-443a-892a-9084fe307fb7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:30.711334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:30.711947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.712282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.712566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.713217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:30.714825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:30.732867 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:30.744246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1132/2236] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:30.750941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee7fef-f867-4c7d-9f6a-d6163c300b60 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:30.767174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732f4a0c-8442-4e23-b48b-5d9cbd6a4e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:30.767884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f4a0c-8442-4e23-b48b-5d9cbd6a4e94 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.768326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f4a0c-8442-4e23-b48b-5d9cbd6a4e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.768668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f4a0c-8442-4e23-b48b-5d9cbd6a4e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.773473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f4a0c-8442-4e23-b48b-5d9cbd6a4e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:30.778039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732f4a0c-8442-4e23-b48b-5d9cbd6a4e94 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:30.812264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:30.823614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1105/2237] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:30.829900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca549ee-4ef4-4484-9db3-14b556a36070 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:30.843513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:30.844355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.844691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.845127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] PATH_INFO: `/v3/projects/2cf5063caac54e439f2427ea30e827ea/users/4db24c8e6f874fcf8e7ad98d179f6f36/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.873375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cf5063caac54e439f2427ea30e827ea, user_id=4db24c8e6f874fcf8e7ad98d179f6f36, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:30.876657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:30.985851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a536c0f-11d1-4de4-92ef-3a0a6a20d917 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:30.986709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a536c0f-11d1-4de4-92ef-3a0a6a20d917 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:30.987207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a536c0f-11d1-4de4-92ef-3a0a6a20d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:30.989998 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1133/2238] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:30 2022] PUT /identity/v3/projects/2cf5063caac54e439f2427ea30e827ea/users/4db24c8e6f874fcf8e7ad98d179f6f36/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:31.067382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5a536c0f-11d1-4de4-92ef-3a0a6a20d917 None None] MFA Rules not processed for user `4db24c8e6f874fcf8e7ad98d179f6f36`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:31.068678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5a536c0f-11d1-4de4-92ef-3a0a6a20d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:31.227966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1106/2239] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:31.239660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:31.243629 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:31.327018 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4746a-28f9-400c-a04b-868b496f9edf admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:31.335312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:31.336134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:31.336816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:31.337206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:31.361140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:31.362632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:31.375209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1134/2240] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:31.645476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c84a9-5eb7-4fcf-aa79-776f8adb4840 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:31.646060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c84a9-5eb7-4fcf-aa79-776f8adb4840 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:31.646509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c84a9-5eb7-4fcf-aa79-776f8adb4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:31.694410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-054c84a9-5eb7-4fcf-aa79-776f8adb4840 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:31.696018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-054c84a9-5eb7-4fcf-aa79-776f8adb4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:31.776347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1107/2241] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:52:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:31.790455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:31.792103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:31.846127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:31.912095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fff27-e001-4365-b629-092a82aca92d service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:31.925793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6ec9-fcd5-4d09-b4d8-ad2f68270391 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:31.927634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6ec9-fcd5-4d09-b4d8-ad2f68270391 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:31.928335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6ec9-fcd5-4d09-b4d8-ad2f68270391 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:31.929201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6ec9-fcd5-4d09-b4d8-ad2f68270391 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:31.948109 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d6ec9-fcd5-4d09-b4d8-ad2f68270391 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:31.952088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d6ec9-fcd5-4d09-b4d8-ad2f68270391 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:31.965874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1135/2242] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:52:32.581408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae040-13ab-42ae-998c-9ef12b33b5c6 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:32.582589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae040-13ab-42ae-998c-9ef12b33b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:32.583094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eae040-13ab-42ae-998c-9ef12b33b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:32.615772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-56eae040-13ab-42ae-998c-9ef12b33b5c6 None None] MFA Rules not processed for user `cae765348a434c4e8cdf46690bb5a167`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:32.617400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-56eae040-13ab-42ae-998c-9ef12b33b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:32.713601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:32.744382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1108/2243] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:33.556058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:33.556621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:33.556621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:33.589058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc1d1-6ca1-4238-8479-cebee9a9cccf None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:33.589613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc1d1-6ca1-4238-8479-cebee9a9cccf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:33.589916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc1d1-6ca1-4238-8479-cebee9a9cccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:33.606604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] MFA Rules not processed for user `4db24c8e6f874fcf8e7ad98d179f6f36`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:33.606604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:33.628785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1136/2244] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:33.640413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3b8fc1d1-6ca1-4238-8479-cebee9a9cccf None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:33.641787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3b8fc1d1-6ca1-4238-8479-cebee9a9cccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:33.806975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1109/2245] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:37.167428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:37.169623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:37.307373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e5dc0-3cd6-4f37-8573-41449cf173f8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:37.314089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:37.315371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:37.315662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:37.315946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:37.326236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:37.327981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:37.363931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1137/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:37.567609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a1d5-e668-4e41-881c-4bf69237e456 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:37.568162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a1d5-e668-4e41-881c-4bf69237e456 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:37.568291 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1a1d5-e668-4e41-881c-4bf69237e456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:37.605670 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-41d1a1d5-e668-4e41-881c-4bf69237e456 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:37.607164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-41d1a1d5-e668-4e41-881c-4bf69237e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:37.636593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1110/2247] 10.222.0.27 () {58 vars in 967 bytes} [Mon Aug 22 05:52:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:37.645260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:37.690101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcaaa8-220b-4f8f-b52f-3768d53f42a3 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:37.710089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:37.712331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:37.712794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:37.713868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:37.736586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:37.740860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:37.758763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1138/2248] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:52:42.268512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e677fd-f513-4402-98a8-0d1e391263a9 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:42.269078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e677fd-f513-4402-98a8-0d1e391263a9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:42.269078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e677fd-f513-4402-98a8-0d1e391263a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:42.314203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-43e677fd-f513-4402-98a8-0d1e391263a9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:42.315730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-43e677fd-f513-4402-98a8-0d1e391263a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:42.329116 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1111/2249] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:42.388431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:42.391298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:42.414446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b51c-8b08-4233-93a7-0d5537e9e932 service swift] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:42.426771 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:42.427623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:42.428008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:42.442233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] PATH_INFO: `/v3/users/e0a261a926d04a8bbda99b6a2154c010` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:42.451710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a261a926d04a8bbda99b6a2154c010)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:42.460824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:42.474234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e677fd-f513-4402-98a8-0d1e391263a9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:42.495206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e677fd-f513-4402-98a8-0d1e391263a9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:42.508313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:42.509803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:42.513864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:42.514336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:42.543269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:42.545176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:42.568703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1112/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:42.735883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a261a926d04a8bbda99b6a2154c010'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:42.736941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a261a926d04a8bbda99b6a2154c010'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:42.738379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a261a926d04a8bbda99b6a2154c010'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:42.762719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a261a926d04a8bbda99b6a2154c010'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:42.870139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2a775380-6edd-423a-9b71-c6488e9626ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a261a926d04a8bbda99b6a2154c010'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:42.888418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:42.896116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1139/2251] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:52:42 2022] DELETE /identity/v3/users/e0a261a926d04a8bbda99b6a2154c010 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:44.008796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:44.019578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966ca81-b6cc-4b36-8b5b-ccd3a806cd5f service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:44.107654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:44.109106 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:44.109605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:44.111091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] PATH_INFO: `/v3/projects/83b34689ea414253a1700a8e057bfa46` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:44.112709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b34689ea414253a1700a8e057bfa46)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:44.116410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:44.291694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b34689ea414253a1700a8e057bfa46', 'request_id': 'req-419ffb77-777a-46a5-bd54-3f688d7cb9d1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:44.298184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b34689ea414253a1700a8e057bfa46', 'request_id': 'req-419ffb77-777a-46a5-bd54-3f688d7cb9d1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:44.316864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b34689ea414253a1700a8e057bfa46', 'request_id': 'req-419ffb77-777a-46a5-bd54-3f688d7cb9d1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:44.396322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] The token cache is being invalidate because project 83b34689ea414253a1700a8e057bfa46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:52:44.401183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:44.401183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-419ffb77-777a-46a5-bd54-3f688d7cb9d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:52:44.405200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1113/2252] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:52:44 2022] DELETE /identity/v3/projects/83b34689ea414253a1700a8e057bfa46 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:44.406662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa66a-ad8b-4d5b-8eaa-a3605b7a11d0 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:44.407195 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa66a-ad8b-4d5b-8eaa-a3605b7a11d0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:44.407347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfa66a-ad8b-4d5b-8eaa-a3605b7a11d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:44.436261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-4bcfa66a-ad8b-4d5b-8eaa-a3605b7a11d0 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:44.436261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4bcfa66a-ad8b-4d5b-8eaa-a3605b7a11d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:44.541477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c396c0b-e706-4d68-9bba-25ab30648cba None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:44.541899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c396c0b-e706-4d68-9bba-25ab30648cba None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:44.542302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c396c0b-e706-4d68-9bba-25ab30648cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:44.546928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1140/2253] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:44.550772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:44.568077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0c396c0b-e706-4d68-9bba-25ab30648cba None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:44.569596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0c396c0b-e706-4d68-9bba-25ab30648cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:44.594280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfa66a-ad8b-4d5b-8eaa-a3605b7a11d0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:44.594964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1114/2254] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:44.609261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfa66a-ad8b-4d5b-8eaa-a3605b7a11d0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:44.614976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:44.615609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:44.615885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:44.616374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:44.617057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:52:44.617377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:44.619079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:44.644950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1141/2255] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:52:44.645861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c396c0b-e706-4d68-9bba-25ab30648cba None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:44.657874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c396c0b-e706-4d68-9bba-25ab30648cba None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:44.674117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:44.674756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:44.675142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:44.675534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:44.676188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:44.679674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:44.813659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1115/2256] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:44 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:52:44.816796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:44.828295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa1a22-804b-4c07-81d5-74ee44c91611 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:44.894873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:44.897314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:44.897314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:44.897314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:44.897577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:44.900705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:45.021937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1142/2257] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:44 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:45.036875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:45.048609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f3768-ed1a-467d-b73c-aebd61ca493f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:45.053718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:45.054535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:45.054998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:45.055380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:45.056757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:45.058582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:45.074228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1116/2258] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:45.075456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:45.088018 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2d501-3c92-4554-be88-7ee0256a1b8d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:45.093430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931daee-9b0e-46d3-a6b8-61d864b9a981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:45.094197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931daee-9b0e-46d3-a6b8-61d864b9a981 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:45.094592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931daee-9b0e-46d3-a6b8-61d864b9a981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:45.095016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931daee-9b0e-46d3-a6b8-61d864b9a981 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:45.095746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931daee-9b0e-46d3-a6b8-61d864b9a981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:45.097534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931daee-9b0e-46d3-a6b8-61d864b9a981 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:45.111185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1143/2259] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:45.122072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:45.132896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3325548-36a6-43a3-bee2-1ebb35f539f9 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:45.144585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:45.145281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:45.145587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:45.145856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] PATH_INFO: `/v3/projects/822e89fc41b14ff5bdedbd915ebb3e8f/users/310d7421cd114072b3f470e27c69d6bb/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:45.163206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=822e89fc41b14ff5bdedbd915ebb3e8f, user_id=310d7421cd114072b3f470e27c69d6bb, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:45.166852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:45.267127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1117/2260] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:45 2022] PUT /identity/v3/projects/822e89fc41b14ff5bdedbd915ebb3e8f/users/310d7421cd114072b3f470e27c69d6bb/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:45.273588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70348468-a05b-4924-959d-8bfe87742312 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:45.273929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70348468-a05b-4924-959d-8bfe87742312 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:45.274430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70348468-a05b-4924-959d-8bfe87742312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:45.300524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-70348468-a05b-4924-959d-8bfe87742312 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:45.302451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-70348468-a05b-4924-959d-8bfe87742312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:45.374686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1144/2261] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:45.391877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:45.393702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:45.458572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd7bdb-2e65-400c-a405-37883e236e3f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:45.463126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:45.463882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:45.464175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:45.464489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:45.475408 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:45.476902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:45.487243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1118/2262] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:46.631090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0e002-bbeb-4bed-a26c-cbffe7d6a08c None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:46.631619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0e002-bbeb-4bed-a26c-cbffe7d6a08c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:46.631719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0e002-bbeb-4bed-a26c-cbffe7d6a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:46.648423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:46.652779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-79c0e002-bbeb-4bed-a26c-cbffe7d6a08c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:46.654091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-79c0e002-bbeb-4bed-a26c-cbffe7d6a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:46.662463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1145/2263] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:46.682753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:46.684366 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:46.787605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5ed8b-90c6-4a74-b72d-b5f2f868ef83 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:46.794139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:46.794759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:46.795044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:46.795519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:46.805406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:46.807704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:46.818637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1119/2264] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:51.788966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa353e-22ff-4bac-bcb3-bf31144e48a2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:51.791118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa353e-22ff-4bac-bcb3-bf31144e48a2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:51.791118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa353e-22ff-4bac-bcb3-bf31144e48a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:51.839862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-93aa353e-22ff-4bac-bcb3-bf31144e48a2 None None] MFA Rules not processed for user `310d7421cd114072b3f470e27c69d6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:51.842800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-93aa353e-22ff-4bac-bcb3-bf31144e48a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:51.928500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1146/2265] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:51.932984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:51.945303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef02ee7-b6f7-44b9-ae63-feb5aa5d170d service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:51.950387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:51.951299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:51.951724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:51.952009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:51.952669 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:51.954830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:52.065603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1120/2266] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:52:51 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:52.069704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa353e-22ff-4bac-bcb3-bf31144e48a2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:52.082503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa353e-22ff-4bac-bcb3-bf31144e48a2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:52.156340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:52.156960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:52.157261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:52.157518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:52.158203 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:52.160133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:52.303804 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1147/2267] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:52:52 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:52:52.304806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:52.312141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:52.320520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107035e-a3c2-4c54-97d4-bf34da1e9ede admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:52.326604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:52.327442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:52.327733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:52.328144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:52.329098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:52.330748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:52.354041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1121/2268] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:52:52.355975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:52.368342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312383c-b23e-4598-86e4-f0a616374751 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:52.374009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:52.374958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:52.375338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:52.376003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] PATH_INFO: `/v3/projects/2b9beee5ff4547fc9e00e3cf090a8925/users/14ec1e03d3f6446fab6f73858843e170/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:52.396156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9beee5ff4547fc9e00e3cf090a8925, user_id=14ec1e03d3f6446fab6f73858843e170, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:52.399238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:52.479319 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1148/2269] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:52 2022] PUT /identity/v3/projects/2b9beee5ff4547fc9e00e3cf090a8925/users/14ec1e03d3f6446fab6f73858843e170/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:52.483276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:52.494635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4d3a-f073-4b0c-981f-1790d32d2bda admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:52.572272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aaaaa8-c3f8-4f3f-b666-640709fa35ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:52.572895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaaaa8-c3f8-4f3f-b666-640709fa35ea admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:52.573177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaaaa8-c3f8-4f3f-b666-640709fa35ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:52.573478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aaaaa8-c3f8-4f3f-b666-640709fa35ea admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:52.574139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaaaa8-c3f8-4f3f-b666-640709fa35ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:52.575749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aaaaa8-c3f8-4f3f-b666-640709fa35ea admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:52.587804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1122/2270] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:52:52.591956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:52.606456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f2dfd-bcb8-4b59-b3d7-09ae854af0e5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:52.615719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126d5b25-6a08-459f-8b3b-3c04326de5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:52.616461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5b25-6a08-459f-8b3b-3c04326de5bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:52.616750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5b25-6a08-459f-8b3b-3c04326de5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:52.618656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d5b25-6a08-459f-8b3b-3c04326de5bd admin admin] PATH_INFO: `/v3/projects/2b9beee5ff4547fc9e00e3cf090a8925/users/14ec1e03d3f6446fab6f73858843e170/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:52.620065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5b25-6a08-459f-8b3b-3c04326de5bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b9beee5ff4547fc9e00e3cf090a8925, user_id=14ec1e03d3f6446fab6f73858843e170, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:52.622845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126d5b25-6a08-459f-8b3b-3c04326de5bd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:52.637377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1149/2271] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:52:52 2022] PUT /identity/v3/projects/2b9beee5ff4547fc9e00e3cf090a8925/users/14ec1e03d3f6446fab6f73858843e170/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:52:55.499843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac273d1a-1303-4523-a067-e01092be2525 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:55.500405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac273d1a-1303-4523-a067-e01092be2525 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:55.500840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac273d1a-1303-4523-a067-e01092be2525 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:55.513142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1123/2272] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:52:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:52:55.513586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af22a-913d-4e51-a5e0-e96740ab7272 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:55.514039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af22a-913d-4e51-a5e0-e96740ab7272 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:55.514677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af22a-913d-4e51-a5e0-e96740ab7272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:55.580206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c05af22a-913d-4e51-a5e0-e96740ab7272 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:55.581708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c05af22a-913d-4e51-a5e0-e96740ab7272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:55.686123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:55.733956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1150/2273] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:52:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:52:55.758097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac273d1a-1303-4523-a067-e01092be2525 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:55.761075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ac273d1a-1303-4523-a067-e01092be2525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:55.834839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac273d1a-1303-4523-a067-e01092be2525 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:55.839053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7d1d8-5d7e-4d7b-b1c3-f33fca1764e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:55.839795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7d1d8-5d7e-4d7b-b1c3-f33fca1764e5 service glance] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:55.840027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7d1d8-5d7e-4d7b-b1c3-f33fca1764e5 service glance] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:55.840360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7d1d8-5d7e-4d7b-b1c3-f33fca1764e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:55.854713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7d1d8-5d7e-4d7b-b1c3-f33fca1764e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:55.856521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7d1d8-5d7e-4d7b-b1c3-f33fca1764e5 service glance] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:55.870075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1124/2274] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:56.107811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd26e3-d89d-4129-9252-3de52c471027 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:56.108461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd26e3-d89d-4129-9252-3de52c471027 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:56.108979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd26e3-d89d-4129-9252-3de52c471027 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:56.111805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1151/2275] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:52:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:52:56.118724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744ae8-d2b3-4d9c-8344-986ed6189fdc None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:56.119605 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744ae8-d2b3-4d9c-8344-986ed6189fdc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:56.119902 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88744ae8-d2b3-4d9c-8344-986ed6189fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:56.174522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-88744ae8-d2b3-4d9c-8344-986ed6189fdc None None] MFA Rules not processed for user `2d46d5905b004073b10e694ab79e7187`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:56.191955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-88744ae8-d2b3-4d9c-8344-986ed6189fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:56.263843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1125/2276] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:52:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:56.277355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd26e3-d89d-4129-9252-3de52c471027 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:56.293370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd26e3-d89d-4129-9252-3de52c471027 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:56.298520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1484b0e-b0e8-4438-8fc7-b597222d877f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:56.299225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1484b0e-b0e8-4438-8fc7-b597222d877f service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:56.299600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1484b0e-b0e8-4438-8fc7-b597222d877f service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:56.299945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1484b0e-b0e8-4438-8fc7-b597222d877f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:56.308236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1484b0e-b0e8-4438-8fc7-b597222d877f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:56.311318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1484b0e-b0e8-4438-8fc7-b597222d877f service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:56.321731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1152/2277] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:52:56.880760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d822f0-c284-4726-b214-dbfcd1d17e7d None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:56.881583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d822f0-c284-4726-b214-dbfcd1d17e7d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:56.885649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d822f0-c284-4726-b214-dbfcd1d17e7d None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:56.888976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1126/2278] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:52:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:52:56.897599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4109c-71fc-49df-ad40-5cd6f61fe567 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:56.903708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4109c-71fc-49df-ad40-5cd6f61fe567 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:56.904183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4109c-71fc-49df-ad40-5cd6f61fe567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:56.942915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2aa4109c-71fc-49df-ad40-5cd6f61fe567 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:56.945383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2aa4109c-71fc-49df-ad40-5cd6f61fe567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:56.971777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1153/2279] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:52:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:56.982687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d822f0-c284-4726-b214-dbfcd1d17e7d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:56.984554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-59d822f0-c284-4726-b214-dbfcd1d17e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:56.999849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d822f0-c284-4726-b214-dbfcd1d17e7d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:57.004185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:57.005152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:57.005531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:57.005875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:57.017681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:57.019213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:57.031394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1127/2280] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:52:59.693915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea7d7-927e-4600-baaa-a079f86555bd None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:59.694398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea7d7-927e-4600-baaa-a079f86555bd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:59.694721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ea7d7-927e-4600-baaa-a079f86555bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:59.732453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5a4ea7d7-927e-4600-baaa-a079f86555bd None None] MFA Rules not processed for user `14ec1e03d3f6446fab6f73858843e170`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:52:59.734505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5a4ea7d7-927e-4600-baaa-a079f86555bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:52:59.828366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1154/2281] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:52:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:52:59.902948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:52:59.914329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b1d22-a29d-4ad9-acd5-b83a9ff5d6be service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:52:59.920505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9676f8-9159-4c95-91fa-79641d9c6adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:52:59.921148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9676f8-9159-4c95-91fa-79641d9c6adb service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:52:59.921436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9676f8-9159-4c95-91fa-79641d9c6adb service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:52:59.921719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9676f8-9159-4c95-91fa-79641d9c6adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:52:59.949547 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:52:59.980995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9676f8-9159-4c95-91fa-79641d9c6adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:52:59.982609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9676f8-9159-4c95-91fa-79641d9c6adb service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:52:59.992014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1128/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:52:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:53:02.728512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:02.729051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:02.729051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:02.749002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] MFA Rules not processed for user `310d7421cd114072b3f470e27c69d6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:02.750239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:02.757329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1155/2283] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:53:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:06.593564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2057a-ccab-4c48-832e-effa38c1b1c4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:06.594970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2057a-ccab-4c48-832e-effa38c1b1c4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:06.595457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2057a-ccab-4c48-832e-effa38c1b1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:06.619504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-36b2057a-ccab-4c48-832e-effa38c1b1c4 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:06.621122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-36b2057a-ccab-4c48-832e-effa38c1b1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:06.694073 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1129/2284] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:53:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:06.706834 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:06.708437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:06.787130 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c2be8-03cc-446e-8b24-af734f569be9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:06.793282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7353ff-b642-4455-bb8a-def893c5ec00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:06.794052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7353ff-b642-4455-bb8a-def893c5ec00 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:06.794397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7353ff-b642-4455-bb8a-def893c5ec00 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:06.794641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7353ff-b642-4455-bb8a-def893c5ec00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:06.803289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7353ff-b642-4455-bb8a-def893c5ec00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:06.805497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7353ff-b642-4455-bb8a-def893c5ec00 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:06.814289 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1156/2285] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:53:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:53:11.529053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3da6-d86f-46a1-a87a-9b3f3f76d40d None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:11.529656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3da6-d86f-46a1-a87a-9b3f3f76d40d None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:11.529656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf3da6-d86f-46a1-a87a-9b3f3f76d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:11.552791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-48cf3da6-d86f-46a1-a87a-9b3f3f76d40d None None] MFA Rules not processed for user `b08d011c70e14b8390400ac8c46b7ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:11.554713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-48cf3da6-d86f-46a1-a87a-9b3f3f76d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:11.618469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1130/2286] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:53:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:15.780439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f407-0a5a-45e6-88df-aca174451b31 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:15.780986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f407-0a5a-45e6-88df-aca174451b31 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:15.781085 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f407-0a5a-45e6-88df-aca174451b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:15.801513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-19d5f407-0a5a-45e6-88df-aca174451b31 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:15.807969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-19d5f407-0a5a-45e6-88df-aca174451b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:15.810195 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1157/2287] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:53:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:15.842993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf3da6-d86f-46a1-a87a-9b3f3f76d40d None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:15.855811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf3da6-d86f-46a1-a87a-9b3f3f76d40d None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:15.860925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:15.861542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:15.861957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:15.862249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:15.871256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:15.872946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:15.881551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1131/2288] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:53:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:53:16.885020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b7400-5db5-4344-b8f9-17a8914fcd49 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:16.886305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b7400-5db5-4344-b8f9-17a8914fcd49 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:16.886691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b7400-5db5-4344-b8f9-17a8914fcd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:16.906414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2a1b7400-5db5-4344-b8f9-17a8914fcd49 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:16.907684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2a1b7400-5db5-4344-b8f9-17a8914fcd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:16.916256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1158/2289] 10.222.0.27 () {58 vars in 967 bytes} [Mon Aug 22 05:53:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:16.930849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:16.942145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb9a47-05f1-4c3a-b578-d06aff5bdba6 service swift] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:16.947772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:16.948476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:16.948764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:16.949047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:16.959170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:16.960863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:16.969818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1132/2290] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:53:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:53:17.631328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d62f-94eb-4e99-a8a6-4a4d26993ed1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:17.635795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d62f-94eb-4e99-a8a6-4a4d26993ed1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:17.635795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05d62f-94eb-4e99-a8a6-4a4d26993ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:17.658720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-7e05d62f-94eb-4e99-a8a6-4a4d26993ed1 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:17.660652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7e05d62f-94eb-4e99-a8a6-4a4d26993ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:17.669140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1159/2291] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:53:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:17.682272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:17.694307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385eead-cc5a-4250-ae47-7c32e7b0ab36 service swift] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:17.700238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:17.704372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:17.704372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:17.704372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:17.711132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:17.712958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:17.725857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1133/2292] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:53:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:53:18.359384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:18.359925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:18.360040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:18.367861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:18.379559 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:18.380792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:18.388572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1160/2293] 10.222.0.27 () {58 vars in 967 bytes} [Mon Aug 22 05:53:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:18.400691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:18.411196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f72e2-8d05-4e55-9029-669bbef91d04 service swift] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:18.416674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:18.417268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:18.417553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:18.417860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:18.425741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:18.427341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:18.435858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1134/2294] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:53:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:53:20.615507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:20.617044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:20.704975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7ba37-3590-4dd0-8862-b4e86340b00b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:20.710171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cad9b-84c3-42c1-9dcd-222b16d65acb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:20.710790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cad9b-84c3-42c1-9dcd-222b16d65acb service placement] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:20.711259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cad9b-84c3-42c1-9dcd-222b16d65acb service placement] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:20.711686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cad9b-84c3-42c1-9dcd-222b16d65acb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:20.716665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-759cad9b-84c3-42c1-9dcd-222b16d65acb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:20.732693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cad9b-84c3-42c1-9dcd-222b16d65acb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:20.739872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cad9b-84c3-42c1-9dcd-222b16d65acb service placement] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:20.746318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1161/2295] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:53:21.070132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:21.071933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:21.107716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:21.169252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f499f93-6591-42c6-b4fb-4a54b4be506e service swift] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:21.175375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:21.176292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:21.176954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:21.177568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] PATH_INFO: `/v3/users/4db24c8e6f874fcf8e7ad98d179f6f36` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:21.178997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db24c8e6f874fcf8e7ad98d179f6f36)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:21.183191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:21.438209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db24c8e6f874fcf8e7ad98d179f6f36'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:21.439295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db24c8e6f874fcf8e7ad98d179f6f36'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:21.440485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db24c8e6f874fcf8e7ad98d179f6f36'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:21.451785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db24c8e6f874fcf8e7ad98d179f6f36'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:21.591146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db24c8e6f874fcf8e7ad98d179f6f36'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:21.656307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1135/2296] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:53:21 2022] DELETE /identity/v3/users/4db24c8e6f874fcf8e7ad98d179f6f36 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:53:21.661837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:21.662397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:21.662397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:21.700522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:21.702008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:21.771913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1162/2297] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:21.783032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:21.784761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:21.937165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a0cc-288c-4fc6-b733-239fa077e23e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:21.949134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641b53c-21bc-493e-bb5c-ece2f7f01865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:21.951393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b53c-21bc-493e-bb5c-ece2f7f01865 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:21.951587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b53c-21bc-493e-bb5c-ece2f7f01865 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:21.951880 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b53c-21bc-493e-bb5c-ece2f7f01865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:21.973208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641b53c-21bc-493e-bb5c-ece2f7f01865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:21.974751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641b53c-21bc-493e-bb5c-ece2f7f01865 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:22.012723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1136/2298] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:53:22.495713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:22.498311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:22.527655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ca797-bcd9-4a81-b6bc-6b2047489edd None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:22.551842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:22.552924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:22.555638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:22.556288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] PATH_INFO: `/v3/projects/2cf5063caac54e439f2427ea30e827ea` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:22.558294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cf5063caac54e439f2427ea30e827ea)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:22.561159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:22.733626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cf5063caac54e439f2427ea30e827ea', 'request_id': 'req-cb95051d-d2d8-4f70-8ead-4127bb4b172d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:22.745051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cf5063caac54e439f2427ea30e827ea', 'request_id': 'req-cb95051d-d2d8-4f70-8ead-4127bb4b172d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:22.822326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cf5063caac54e439f2427ea30e827ea', 'request_id': 'req-cb95051d-d2d8-4f70-8ead-4127bb4b172d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:22.843618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] The token cache is being invalidate because project 2cf5063caac54e439f2427ea30e827ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:53:22.844434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:22.845311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:53:22.849599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1163/2299] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:53:22 2022] DELETE /identity/v3/projects/2cf5063caac54e439f2427ea30e827ea => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:53:26.100672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c6cd-4dc4-48a6-8dcc-632d6c8cc16e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:26.101576 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c6cd-4dc4-48a6-8dcc-632d6c8cc16e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:26.102568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c6cd-4dc4-48a6-8dcc-632d6c8cc16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:26.127003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d155c6cd-4dc4-48a6-8dcc-632d6c8cc16e None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:26.128165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d155c6cd-4dc4-48a6-8dcc-632d6c8cc16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:26.171523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:26.185794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1137/2300] 10.222.0.27 () {58 vars in 967 bytes} [Mon Aug 22 05:53:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:26.198848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:26.200281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:26.211822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:26.269031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95051d-d2d8-4f70-8ead-4127bb4b172d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:26.274890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a630d5-8ca8-4ef3-ae2f-c5eaafc51fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:26.275718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a630d5-8ca8-4ef3-ae2f-c5eaafc51fa6 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:26.276350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a630d5-8ca8-4ef3-ae2f-c5eaafc51fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:26.276593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a630d5-8ca8-4ef3-ae2f-c5eaafc51fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:26.293407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a630d5-8ca8-4ef3-ae2f-c5eaafc51fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:26.295632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a630d5-8ca8-4ef3-ae2f-c5eaafc51fa6 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:26.310849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1164/2301] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:53:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:53:36.812230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:37.020146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=28 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:38.559030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:38.559512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:38.559618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:38.583756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] MFA Rules not processed for user `d7d7577ea743410ca308f62b04e7cf58`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:38.585029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:38.644884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1138/2302] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:53:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:38.979228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:38.979777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:38.979906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:39.008917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:39.008917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:39.070615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1165/2303] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:53:39.330094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:39.331569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:39.343815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:39.345240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:39.406179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fc4c0-24c1-417c-bda7-5b01a7469d92 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:39.409934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:39.410549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:39.410933 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:39.411111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:39.412882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:39.421632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b859d19-7e20-4b29-bfd9-d34fb2fe19dc None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:39.433544 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26585e-6b3e-4a51-a1be-586b439d2c35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:39.435206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26585e-6b3e-4a51-a1be-586b439d2c35 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:39.436040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26585e-6b3e-4a51-a1be-586b439d2c35 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:39.436543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26585e-6b3e-4a51-a1be-586b439d2c35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:39.447666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26585e-6b3e-4a51-a1be-586b439d2c35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:39.450076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26585e-6b3e-4a51-a1be-586b439d2c35 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:39.461598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1139/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:53:39.489907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:39.491518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:39.507307 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1166/2305] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:53:43.593410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47504a0-55e5-4893-ac4e-f1d2c5b87b86 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:43.593801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47504a0-55e5-4893-ac4e-f1d2c5b87b86 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:43.593994 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47504a0-55e5-4893-ac4e-f1d2c5b87b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:43.615318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b47504a0-55e5-4893-ac4e-f1d2c5b87b86 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:43.616598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b47504a0-55e5-4893-ac4e-f1d2c5b87b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:43.625729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1140/2306] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:43.643485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:43.646314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:43.663214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055a074-f85f-481c-a998-095b11d29a2d service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:43.673142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:43.673778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:43.674059 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:43.674335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:43.683674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:43.685852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:43.696572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1167/2307] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:53:46.385840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24bf27-9971-4235-a5fd-f2bdd96548e5 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:46.386449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24bf27-9971-4235-a5fd-f2bdd96548e5 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:46.386449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24bf27-9971-4235-a5fd-f2bdd96548e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:46.406536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-aa24bf27-9971-4235-a5fd-f2bdd96548e5 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:46.407807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-aa24bf27-9971-4235-a5fd-f2bdd96548e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:46.418950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1141/2308] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:46.436456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:46.487930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53526b8b-489e-4ca5-a3ed-0e142aa799f5 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:46.487930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:46.487930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:46.487930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:46.488661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:46.488661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:46.488661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:46.488661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1168/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:53:50.616512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2480-1762-4627-b2ea-8a2a92e0a8dc None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:50.616512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2480-1762-4627-b2ea-8a2a92e0a8dc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:50.616512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2480-1762-4627-b2ea-8a2a92e0a8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:50.635834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-70fd2480-1762-4627-b2ea-8a2a92e0a8dc None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:50.637060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-70fd2480-1762-4627-b2ea-8a2a92e0a8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:50.645456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1142/2310] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:50.666174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:50.678058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13043b-e505-48aa-9996-840ded5b5bd0 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:50.683576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:50.684170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:50.684487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:50.684783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:50.692876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:50.694456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:50.704187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1169/2311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:53:54.901027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3e64-9a0a-42de-b3b7-e368728e9dc8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:54.901522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3e64-9a0a-42de-b3b7-e368728e9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:54.901701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3e64-9a0a-42de-b3b7-e368728e9dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:54.922009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fc5a3e64-9a0a-42de-b3b7-e368728e9dc8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:53:54.923246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fc5a3e64-9a0a-42de-b3b7-e368728e9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:53:54.931201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1143/2312] 10.222.0.17 () {58 vars in 1016 bytes} [Mon Aug 22 05:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:53:54.946269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:53:54.957667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c88000-3185-41dc-ba71-d425c304f431 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:53:54.963166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bceb75f-18c7-4732-9363-14173ef8440e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:53:54.963767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb75f-18c7-4732-9363-14173ef8440e service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:53:54.964048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb75f-18c7-4732-9363-14173ef8440e service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:53:54.964350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb75f-18c7-4732-9363-14173ef8440e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:53:54.973058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bceb75f-18c7-4732-9363-14173ef8440e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:53:54.974627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bceb75f-18c7-4732-9363-14173ef8440e service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:53:54.978526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:53:54.985112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1170/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:54:04.916032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=71 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:05.030837 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:14.969130 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:14.970171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:14.970297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:14.988705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] MFA Rules not processed for user `cae765348a434c4e8cdf46690bb5a167`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:54:14.989916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:15.044468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1144/2314] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:54:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:54:23.636285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a640f-37c1-46e5-a7b2-8a89797d31d4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:23.636789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a640f-37c1-46e5-a7b2-8a89797d31d4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:23.636893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a640f-37c1-46e5-a7b2-8a89797d31d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:23.656540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-466a640f-37c1-46e5-a7b2-8a89797d31d4 None None] MFA Rules not processed for user `a844362c07764ff9b43719573f6cdbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:54:23.657767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-466a640f-37c1-46e5-a7b2-8a89797d31d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:23.713092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1171/2315] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:54:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:54:25.037564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=25 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:28.144002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:28.150563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:28.173730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a2790-53b7-4fab-86c0-18bbd1d89194 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:28.178841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:28.179743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:28.180475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:28.181027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] PATH_INFO: `/v3/users/b08d011c70e14b8390400ac8c46b7ed1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:28.182954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08d011c70e14b8390400ac8c46b7ed1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:28.185010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:28.354100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08d011c70e14b8390400ac8c46b7ed1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:28.354763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08d011c70e14b8390400ac8c46b7ed1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:28.355380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08d011c70e14b8390400ac8c46b7ed1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:28.363089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08d011c70e14b8390400ac8c46b7ed1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:28.431585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-c241d4a3-8308-4682-83ea-ab344767e098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08d011c70e14b8390400ac8c46b7ed1'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:28.451673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1145/2316] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:54:28 2022] DELETE /identity/v3/users/b08d011c70e14b8390400ac8c46b7ed1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:54:28.750437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a640f-37c1-46e5-a7b2-8a89797d31d4 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:28.768645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a640f-37c1-46e5-a7b2-8a89797d31d4 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:28.841929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:28.842494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:28.842778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:28.843058 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] PATH_INFO: `/v3/projects/c34c30608cdf4093b4b5c6f731c1043f` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:28.844246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34c30608cdf4093b4b5c6f731c1043f)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:28.846191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:28.932037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34c30608cdf4093b4b5c6f731c1043f', 'request_id': 'req-29e43fec-283d-416f-b769-aa247a721492'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:28.938349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34c30608cdf4093b4b5c6f731c1043f', 'request_id': 'req-29e43fec-283d-416f-b769-aa247a721492'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:28.993596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34c30608cdf4093b4b5c6f731c1043f', 'request_id': 'req-29e43fec-283d-416f-b769-aa247a721492'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:29.005141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] The token cache is being invalidate because project c34c30608cdf4093b4b5c6f731c1043f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:54:29.005436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:29.006084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-29e43fec-283d-416f-b769-aa247a721492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:29.007770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1172/2317] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:54:28 2022] DELETE /identity/v3/projects/c34c30608cdf4093b4b5c6f731c1043f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:54:29.012639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3908-e5ec-4f1c-b7e7-36b1d80fdd9a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.012930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3908-e5ec-4f1c-b7e7-36b1d80fdd9a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.013209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a3908-e5ec-4f1c-b7e7-36b1d80fdd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.035214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-1b3a3908-e5ec-4f1c-b7e7-36b1d80fdd9a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:54:29.036448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1b3a3908-e5ec-4f1c-b7e7-36b1d80fdd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:29.102776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1146/2318] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:54:29.110666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdd740-5ee1-4edd-9929-4141deffab8e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.110953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdd740-5ee1-4edd-9929-4141deffab8e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.111236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdd740-5ee1-4edd-9929-4141deffab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.132031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-19fdd740-5ee1-4edd-9929-4141deffab8e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:54:29.133306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-19fdd740-5ee1-4edd-9929-4141deffab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:29.141495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1173/2319] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:54:29.146003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3908-e5ec-4f1c-b7e7-36b1d80fdd9a None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:29.155805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a3908-e5ec-4f1c-b7e7-36b1d80fdd9a None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:29.160662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:29.161319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.161596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.161869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.162522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:54:29.162826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:29.164480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:29.176734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1147/2320] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:54:29.181177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdd740-5ee1-4edd-9929-4141deffab8e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:29.190433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdd740-5ee1-4edd-9929-4141deffab8e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:29.199154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:29.199875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.200243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.200584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.201274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:29.203210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:29.309325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1174/2321] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:54:29 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:54:29.313604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:29.324088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42391bd9-9d90-4744-94b7-f75e769591c5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:29.380555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:29.381161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.381447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.381743 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.382386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:29.384333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:29.391960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:29.461988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1148/2322] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:54:29 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:54:29.466229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:29.477091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413b6e8-9ac1-42fb-9d68-22e5d0fa1a55 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:29.481799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:29.482392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.482673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.482948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.483640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:29.485294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:29.486528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:29.496259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1175/2323] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:54:29.500184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:29.509910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ed0d5-b769-4701-9952-d6f0db7920f6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:29.515197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e002730-e82a-4abf-aadd-19aff1648b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:29.515790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002730-e82a-4abf-aadd-19aff1648b7e admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.516074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002730-e82a-4abf-aadd-19aff1648b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.516383 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002730-e82a-4abf-aadd-19aff1648b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.517087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e002730-e82a-4abf-aadd-19aff1648b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:29.518738 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e002730-e82a-4abf-aadd-19aff1648b7e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:29.529279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1149/2324] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:54:29.533255 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:29.544550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec374d84-c2d2-471f-be36-003af944676d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:29.549137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:29.552143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.552143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.552143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] PATH_INFO: `/v3/projects/a9e670f3baef492e9e9d1b93b883855e/users/cd445f43b66241a28710748bf0b15f58/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.565357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e670f3baef492e9e9d1b93b883855e, user_id=cd445f43b66241a28710748bf0b15f58, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:29.567973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:29.655621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1176/2325] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:54:29 2022] PUT /identity/v3/projects/a9e670f3baef492e9e9d1b93b883855e/users/cd445f43b66241a28710748bf0b15f58/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:54:29.670455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a5688-1889-42c3-a2c6-8d19b67ff481 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.670748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a5688-1889-42c3-a2c6-8d19b67ff481 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.671028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a5688-1889-42c3-a2c6-8d19b67ff481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.699193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-318a5688-1889-42c3-a2c6-8d19b67ff481 None None] MFA Rules not processed for user `cd445f43b66241a28710748bf0b15f58`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:54:29.700463 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-318a5688-1889-42c3-a2c6-8d19b67ff481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:29.763657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1150/2326] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:54:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:54:29.775485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:29.777296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:29.833287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890fd85-9a7e-4e3e-8e8e-38e2888583bd admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:29.836961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a4d48-f7ac-4972-b35e-a2e7d32be4e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:29.837568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4d48-f7ac-4972-b35e-a2e7d32be4e8 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:29.837853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4d48-f7ac-4972-b35e-a2e7d32be4e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:29.838136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a4d48-f7ac-4972-b35e-a2e7d32be4e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:29.846202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a4d48-f7ac-4972-b35e-a2e7d32be4e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:29.848260 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a4d48-f7ac-4972-b35e-a2e7d32be4e8 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:29.856916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1177/2327] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:54:29 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:54:35.629085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a5688-1889-42c3-a2c6-8d19b67ff481 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:35.691177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a5688-1889-42c3-a2c6-8d19b67ff481 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:35.695719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:35.696402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:35.696684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:35.696967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] PATH_INFO: `/v3/users/cd445f43b66241a28710748bf0b15f58` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:35.698089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd445f43b66241a28710748bf0b15f58)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:35.700008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:35.918742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd445f43b66241a28710748bf0b15f58'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:35.919455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd445f43b66241a28710748bf0b15f58'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:35.921009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd445f43b66241a28710748bf0b15f58'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:35.928549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd445f43b66241a28710748bf0b15f58'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:36.002847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd445f43b66241a28710748bf0b15f58'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:36.008734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:36.021937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1151/2328] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:54:35 2022] DELETE /identity/v3/users/cd445f43b66241a28710748bf0b15f58 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:54:36.026413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:36.026852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:36.026965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:36.045317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:54:36.046517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:36.106111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1178/2329] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:54:36.117305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:36.118721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:36.186195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1facf0-6fdc-4c6d-a35a-dd2f3f75f7fa admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:36.190286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d19e3-1501-466a-bc91-54c129dead45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:36.191035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d19e3-1501-466a-bc91-54c129dead45 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:36.191444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d19e3-1501-466a-bc91-54c129dead45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:36.191633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d19e3-1501-466a-bc91-54c129dead45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:36.203925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d19e3-1501-466a-bc91-54c129dead45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:36.205508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d19e3-1501-466a-bc91-54c129dead45 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:36.218549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1152/2330] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:54:36.891141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:54:36.892846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:36.906139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78551282-ea84-41d8-9b72-22d31467ebe9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:54:36.910999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:54:36.911634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:36.912525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:36.912808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] PATH_INFO: `/v3/projects/a9e670f3baef492e9e9d1b93b883855e` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:36.913936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e670f3baef492e9e9d1b93b883855e)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:54:36.915911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:54:37.039016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e670f3baef492e9e9d1b93b883855e', 'request_id': 'req-4408dae3-2b00-4b3f-8cab-1bb103a504f5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:37.045296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e670f3baef492e9e9d1b93b883855e', 'request_id': 'req-4408dae3-2b00-4b3f-8cab-1bb103a504f5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:37.117424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e670f3baef492e9e9d1b93b883855e', 'request_id': 'req-4408dae3-2b00-4b3f-8cab-1bb103a504f5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:37.126084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:37.133079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] The token cache is being invalidate because project a9e670f3baef492e9e9d1b93b883855e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:54:37.133602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:37.134674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4408dae3-2b00-4b3f-8cab-1bb103a504f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:54:37.137726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1179/2331] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:54:36 2022] DELETE /identity/v3/projects/a9e670f3baef492e9e9d1b93b883855e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:54:42.398388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:54:42.398855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:54:42.398950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:54:42.417877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] MFA Rules not processed for user `3c3e9dcf324348a595fdd62d901b8a93`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:54:42.419030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:54:42.473107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1153/2332] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:54:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:54:47.375518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:54:52.466888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=56,keystone:DELETE=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:01.652151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:01.652715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:01.652815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:01.672756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] MFA Rules not processed for user `d7d7577ea743410ca308f62b04e7cf58`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:01.674812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:01.731554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1180/2333] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:08.084820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:08.086683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:08.153447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2bcc5-80db-4adb-9420-5564c979dc6b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:08.159503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:08.160532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:08.160818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:08.161094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:08.163199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:08.242444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:08.243983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:08.257325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1154/2334] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:11.724501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=25 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:12.477829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:12.479225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:12.491485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b928c-a6ae-4489-a716-79d0fe27acf8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:12.495041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:12.495664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:12.495943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:12.496241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:12.497878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:12.511784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:12.513275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:12.524153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1181/2335] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:13.086802 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:13.088173 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:13.102807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173746a8-51b7-4857-855e-275f66ca45f4 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:13.108260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:13.108854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:13.109136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:13.109411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:13.111064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:13.121309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:13.122940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:13.132082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1155/2336] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:22.519499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=6 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:23.127626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=60 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:23.375979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:23.385093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ec12a-a18e-40c5-a9aa-b629e869c1d1 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:23.388672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:23.389262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:23.389543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:23.389819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:23.391511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:23.452700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:23.454204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:23.463874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1182/2337] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:27.102260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:27.103917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:27.118668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e366258a-1c31-4052-bd10-c892ca799188 service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:27.123720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:27.124445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:27.124732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:27.125019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] PATH_INFO: `/v3/users/cae765348a434c4e8cdf46690bb5a167` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:27.126191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae765348a434c4e8cdf46690bb5a167)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:27.128123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:27.298046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae765348a434c4e8cdf46690bb5a167'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.298700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae765348a434c4e8cdf46690bb5a167'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.299301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae765348a434c4e8cdf46690bb5a167'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.306621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae765348a434c4e8cdf46690bb5a167'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.366197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-984373b8-eaa7-4787-bbee-61b2dd734b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae765348a434c4e8cdf46690bb5a167'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.387416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1156/2338] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:55:27 2022] DELETE /identity/v3/users/cae765348a434c4e8cdf46690bb5a167 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:27.617544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:27.627679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e00ce-3987-4b20-ace9-0403be11b59c service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:27.684381 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:27.685008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:27.685292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:27.685570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] PATH_INFO: `/v3/projects/e9d8a7f6afec4b548ad6ddcf288d6835` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:27.686688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9d8a7f6afec4b548ad6ddcf288d6835)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:27.688632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:27.809943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9d8a7f6afec4b548ad6ddcf288d6835', 'request_id': 'req-64003866-a361-4b56-bf4f-adee56b20c63'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.815981 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9d8a7f6afec4b548ad6ddcf288d6835', 'request_id': 'req-64003866-a361-4b56-bf4f-adee56b20c63'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.872848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9d8a7f6afec4b548ad6ddcf288d6835', 'request_id': 'req-64003866-a361-4b56-bf4f-adee56b20c63'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.882825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] The token cache is being invalidate because project e9d8a7f6afec4b548ad6ddcf288d6835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:55:27.883118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.883734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-64003866-a361-4b56-bf4f-adee56b20c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:27.885235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1183/2339] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:55:27 2022] DELETE /identity/v3/projects/e9d8a7f6afec4b548ad6ddcf288d6835 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:27.890099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4582f-141f-4e46-91f3-8fbfda09dfdb None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:27.890387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4582f-141f-4e46-91f3-8fbfda09dfdb None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:27.890663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4582f-141f-4e46-91f3-8fbfda09dfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:27.910186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d8d4582f-141f-4e46-91f3-8fbfda09dfdb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:27.911379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d8d4582f-141f-4e46-91f3-8fbfda09dfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:27.968952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1157/2340] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:27.977180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea469d1b-479b-44ce-988f-84e74115db13 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:27.977483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea469d1b-479b-44ce-988f-84e74115db13 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:27.977760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea469d1b-479b-44ce-988f-84e74115db13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:27.998175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ea469d1b-479b-44ce-988f-84e74115db13 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:27.999377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ea469d1b-479b-44ce-988f-84e74115db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:28.007939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1184/2341] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:28.012174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4582f-141f-4e46-91f3-8fbfda09dfdb None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.022216 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4582f-141f-4e46-91f3-8fbfda09dfdb None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.026962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.027604 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.027894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.028174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.028866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:55:28.029184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.030824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.043260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1158/2342] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:55:28.047647 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea469d1b-479b-44ce-988f-84e74115db13 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.057009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea469d1b-479b-44ce-988f-84e74115db13 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.061779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.062384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.062667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.062944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.063591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.065532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.081025 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:28.091733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.093485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:28.145146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1185/2343] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:55:28 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:55:28.149446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.153841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f732e-000d-4217-bf10-6b05cfde9f80 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.166093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:28.202619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.203228 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.203511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.203791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.205790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:28.211966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb7736-e77b-4b55-bcd2-bf0fd5abc474 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.217471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.218155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.218446 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.218734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.219364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.221365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.265415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.266860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.276441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1159/2344] 10.222.0.27 () {60 vars in 1396 bytes} [Mon Aug 22 05:55:28 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:55:28.339786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1186/2345] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:55:28 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:55:28.347626 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.358163 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65df2-aa2c-4037-bf46-9479cd8d1d00 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.362692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.363283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.363564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.363840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.364509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.366122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.375655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1160/2346] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:28.379566 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.389744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3d704-8dbd-4f24-b019-c17881bae8f5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.394436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357093fe-3642-4d40-afbb-4cde40c414cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.395020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357093fe-3642-4d40-afbb-4cde40c414cb admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.395351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357093fe-3642-4d40-afbb-4cde40c414cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.395573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357093fe-3642-4d40-afbb-4cde40c414cb admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.396238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357093fe-3642-4d40-afbb-4cde40c414cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.398480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357093fe-3642-4d40-afbb-4cde40c414cb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.408056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1187/2347] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:28.412097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.421953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a604dd-169b-413a-aa97-1413305934ad admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.426581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.445838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.445838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.445838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] PATH_INFO: `/v3/projects/aca7cf48ae924d69b80947c18175711b/users/b7105650b2654aeba77c34c954b46658/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.445838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca7cf48ae924d69b80947c18175711b, user_id=b7105650b2654aeba77c34c954b46658, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.445838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.515148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1161/2348] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:55:28 2022] PUT /identity/v3/projects/aca7cf48ae924d69b80947c18175711b/users/b7105650b2654aeba77c34c954b46658/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:28.526097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5d37-3450-4180-a5d8-186e0954b253 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.526407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5d37-3450-4180-a5d8-186e0954b253 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.526744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c5d37-3450-4180-a5d8-186e0954b253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.554324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-479c5d37-3450-4180-a5d8-186e0954b253 None None] MFA Rules not processed for user `b7105650b2654aeba77c34c954b46658`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:28.555534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-479c5d37-3450-4180-a5d8-186e0954b253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:28.617947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1188/2349] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:28.622433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.682243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628c777-6f1f-43e7-bb12-94ecc43b4ae3 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.686792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.687377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.687657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.687931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.688597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.690525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.771047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1162/2350] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:55:28 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:55:28.775077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5d37-3450-4180-a5d8-186e0954b253 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.785999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c5d37-3450-4180-a5d8-186e0954b253 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.842192 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.842803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.843086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.843362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.844016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.845980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.855581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:28.930636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1189/2351] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:55:28 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:55:28.934672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.945608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e320b-9701-4871-85fa-ab629b60cf25 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.950235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.955714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.955714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.955714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:28.955714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:28.955714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:28.964627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1163/2352] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:28.968843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:28.979261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58918c38-afaa-42eb-924e-90c8113404e4 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:28.984008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:28.984696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:28.984980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:28.985261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] PATH_INFO: `/v3/projects/9d7ea9f92f9c4f03827918d8b079eb9a/users/7349e0df1e7a41819ee48d44a56e10e4/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:29.000362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7ea9f92f9c4f03827918d8b079eb9a, user_id=7349e0df1e7a41819ee48d44a56e10e4, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:29.003394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:29.092325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1190/2353] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:55:28 2022] PUT /identity/v3/projects/9d7ea9f92f9c4f03827918d8b079eb9a/users/7349e0df1e7a41819ee48d44a56e10e4/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:29.096472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:29.106505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0f494-e081-424f-84d5-3fcc68ab8780 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:29.111044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:29.161991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3065d2-ed19-47d9-8d34-ec3103335852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:29.162672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3065d2-ed19-47d9-8d34-ec3103335852 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:29.162905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3065d2-ed19-47d9-8d34-ec3103335852 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:29.163179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3065d2-ed19-47d9-8d34-ec3103335852 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:29.163815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3065d2-ed19-47d9-8d34-ec3103335852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:29.165511 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3065d2-ed19-47d9-8d34-ec3103335852 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:29.174958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1164/2354] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:29.179280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:29.189919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526462f-7db2-47aa-9595-134314b59213 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:29.195103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:29.195744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:29.196045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:29.196354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] PATH_INFO: `/v3/projects/9d7ea9f92f9c4f03827918d8b079eb9a/users/7349e0df1e7a41819ee48d44a56e10e4/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:29.198304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7ea9f92f9c4f03827918d8b079eb9a, user_id=7349e0df1e7a41819ee48d44a56e10e4, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:29.200970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:29.211945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1191/2355] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:55:29 2022] PUT /identity/v3/projects/9d7ea9f92f9c4f03827918d8b079eb9a/users/7349e0df1e7a41819ee48d44a56e10e4/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:29.223406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e30fe-bad3-443c-867e-8a2ba0827039 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:29.223696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e30fe-bad3-443c-867e-8a2ba0827039 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:29.223984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e30fe-bad3-443c-867e-8a2ba0827039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:29.250908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-703e30fe-bad3-443c-867e-8a2ba0827039 None None] MFA Rules not processed for user `7349e0df1e7a41819ee48d44a56e10e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:29.252103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-703e30fe-bad3-443c-867e-8a2ba0827039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:29.325411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1165/2356] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:29.337729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:29.339436 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:29.396975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886f8cc-a8be-4a7e-8b7b-bdeb9da21e3a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:29.400682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea269ee-29f3-4d95-989a-0d72c496982a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:29.401290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea269ee-29f3-4d95-989a-0d72c496982a service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:29.401572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea269ee-29f3-4d95-989a-0d72c496982a service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:29.401849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea269ee-29f3-4d95-989a-0d72c496982a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:29.411150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea269ee-29f3-4d95-989a-0d72c496982a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:29.412697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea269ee-29f3-4d95-989a-0d72c496982a service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:29.422447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1192/2357] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:30.320424 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e30fe-bad3-443c-867e-8a2ba0827039 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:30.386267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e30fe-bad3-443c-867e-8a2ba0827039 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:30.390910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:30.391541 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:30.391822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:30.392187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] PATH_INFO: `/v3/users/b7105650b2654aeba77c34c954b46658` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:30.393389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7105650b2654aeba77c34c954b46658)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:30.395314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:30.562339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:30.574718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7105650b2654aeba77c34c954b46658'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:30.575392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7105650b2654aeba77c34c954b46658'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:30.576058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7105650b2654aeba77c34c954b46658'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:30.583064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7105650b2654aeba77c34c954b46658'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:30.663562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7105650b2654aeba77c34c954b46658'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:30.683166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1166/2358] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:55:30 2022] DELETE /identity/v3/users/b7105650b2654aeba77c34c954b46658 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:30.687698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:30.688177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:30.688283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:30.714715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:30.715928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:30.773942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1193/2359] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:55:30.783518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:30.784972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:30.841865 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaa101-ba20-4dec-ac29-ad5d6fa3d9f9 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:30.845405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:30.846010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:30.846296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:30.846577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:30.855420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:30.856887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:30.866728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1167/2360] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:31.259155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:31.263052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:31.272329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16f7ff-593e-49e3-9caa-80fcc0eedc55 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:31.276967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:31.277602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:31.277888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:31.278166 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] PATH_INFO: `/v3/projects/aca7cf48ae924d69b80947c18175711b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:31.279373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca7cf48ae924d69b80947c18175711b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:31.281315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:31.418161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca7cf48ae924d69b80947c18175711b', 'request_id': 'req-9379ef88-cebd-4f43-ba21-e36c65276a2d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.424358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca7cf48ae924d69b80947c18175711b', 'request_id': 'req-9379ef88-cebd-4f43-ba21-e36c65276a2d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.426010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:31.509116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca7cf48ae924d69b80947c18175711b', 'request_id': 'req-9379ef88-cebd-4f43-ba21-e36c65276a2d'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.519969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] The token cache is being invalidate because project aca7cf48ae924d69b80947c18175711b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:55:31.520298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.520920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.522414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1194/2361] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:55:31 2022] DELETE /identity/v3/projects/aca7cf48ae924d69b80947c18175711b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:31.526388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:31.536281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51198df3-2cd9-4d0e-ae35-13e36362415f service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:31.591715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:31.592381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:31.592668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:31.592947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] PATH_INFO: `/v3/users/7349e0df1e7a41819ee48d44a56e10e4` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:31.594068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7349e0df1e7a41819ee48d44a56e10e4)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:31.595984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:31.761013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7349e0df1e7a41819ee48d44a56e10e4'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.761695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7349e0df1e7a41819ee48d44a56e10e4'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.762294 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7349e0df1e7a41819ee48d44a56e10e4'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.767694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:31.769752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7349e0df1e7a41819ee48d44a56e10e4'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.833230 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-57f15224-e50d-4f08-8b2e-3d1139712841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7349e0df1e7a41819ee48d44a56e10e4'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:31.853496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1168/2362] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:55:31 2022] DELETE /identity/v3/users/7349e0df1e7a41819ee48d44a56e10e4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:32.270523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:32.272622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:32.286028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379ef88-cebd-4f43-ba21-e36c65276a2d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:32.344308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:32.344962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.345244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.345521 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] PATH_INFO: `/v3/projects/9d7ea9f92f9c4f03827918d8b079eb9a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.346782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7ea9f92f9c4f03827918d8b079eb9a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:32.348770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:32.429211 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7ea9f92f9c4f03827918d8b079eb9a', 'request_id': 'req-4e1b7805-30bf-4427-a204-93fd56b06382'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:32.435359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7ea9f92f9c4f03827918d8b079eb9a', 'request_id': 'req-4e1b7805-30bf-4427-a204-93fd56b06382'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:32.492204 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7ea9f92f9c4f03827918d8b079eb9a', 'request_id': 'req-4e1b7805-30bf-4427-a204-93fd56b06382'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:32.502662 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] The token cache is being invalidate because project 9d7ea9f92f9c4f03827918d8b079eb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:55:32.502955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:32.504805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4e1b7805-30bf-4427-a204-93fd56b06382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:32.505090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1195/2363] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:55:32 2022] DELETE /identity/v3/projects/9d7ea9f92f9c4f03827918d8b079eb9a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:32.510575 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c432-b4a7-4dce-9ab7-8c416283ef2c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.510870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c432-b4a7-4dce-9ab7-8c416283ef2c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.511178 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404c432-b4a7-4dce-9ab7-8c416283ef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.533489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d404c432-b4a7-4dce-9ab7-8c416283ef2c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:32.533489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d404c432-b4a7-4dce-9ab7-8c416283ef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:32.590156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1169/2364] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:32.597740 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31e41-6ecd-4553-a788-bbb4cdea1040 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.598060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31e41-6ecd-4553-a788-bbb4cdea1040 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.598344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac31e41-6ecd-4553-a788-bbb4cdea1040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.617844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-bac31e41-6ecd-4553-a788-bbb4cdea1040 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:32.619043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-bac31e41-6ecd-4553-a788-bbb4cdea1040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:32.626813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1196/2365] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:32.630965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c432-b4a7-4dce-9ab7-8c416283ef2c None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:32.641048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404c432-b4a7-4dce-9ab7-8c416283ef2c None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:32.645625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:32.646218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.646505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.646783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.647437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:55:32.647749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:32.649387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:32.660635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1170/2366] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:55:32.664774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31e41-6ecd-4553-a788-bbb4cdea1040 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:32.673667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac31e41-6ecd-4553-a788-bbb4cdea1040 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:32.678727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:32.679305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.679586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.679856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.680503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:32.682404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:32.761686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1197/2367] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:55:32 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:55:32.766001 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:32.775966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04181e5-991a-419a-af98-b5621c6f6d13 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:32.832046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:32.832609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.832922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.833200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.833836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:32.836063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:32.913377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1171/2368] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:55:32 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:55:32.914598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:32.925462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a3c84-b4c1-4b72-a7c9-1762fbc20d32 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:32.930864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:32.931488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.931774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.932060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.932742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:32.934390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:32.944753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1198/2369] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:32.951350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:32.961964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec197d3-96f6-4b90-9fb2-7300c47660fe admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:32.966680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8bb65-d85c-47e8-88db-23bde3882c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:32.967288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb65-d85c-47e8-88db-23bde3882c01 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:32.967576 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb65-d85c-47e8-88db-23bde3882c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:32.967858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb65-d85c-47e8-88db-23bde3882c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:32.968578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8bb65-d85c-47e8-88db-23bde3882c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:32.970192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8bb65-d85c-47e8-88db-23bde3882c01 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:32.985615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1172/2370] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:55:32.986885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:32.997493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3015c-020e-410c-be5b-124aa99604df admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.002830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.003526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.003811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.004092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] PATH_INFO: `/v3/projects/afd4c5a8ff164f4584c8dc01ad4cb325/users/1df5400f4f88471cb5ea3b5f1de03d95/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.019626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd4c5a8ff164f4584c8dc01ad4cb325, user_id=1df5400f4f88471cb5ea3b5f1de03d95, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.022391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.109042 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1199/2371] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:55:32 2022] PUT /identity/v3/projects/afd4c5a8ff164f4584c8dc01ad4cb325/users/1df5400f4f88471cb5ea3b5f1de03d95/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:33.121100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdb18-af0d-4fd5-afd8-0b46539161ea None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.121394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdb18-af0d-4fd5-afd8-0b46539161ea None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.121677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdb18-af0d-4fd5-afd8-0b46539161ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.149171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-268cdb18-af0d-4fd5-afd8-0b46539161ea None None] MFA Rules not processed for user `1df5400f4f88471cb5ea3b5f1de03d95`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:33.150379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-268cdb18-af0d-4fd5-afd8-0b46539161ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:33.176555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:33.214382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1173/2372] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:33.218753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.229285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:INSERT=4,keystone:DELETE=10,keystone:SELECT=86 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:33.278549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db4f16-4a97-4461-b60b-13cb56b6f5b9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.283456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.284067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.284391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.284676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.285391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.287906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.424262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1200/2373] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:55:33 2022] POST /identity/v3/projects => generated 377 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:55:33.428316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cdb18-af0d-4fd5-afd8-0b46539161ea None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.439016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cdb18-af0d-4fd5-afd8-0b46539161ea None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.458948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.461414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:33.497405 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.498045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.498331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.498603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.499244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.501243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.533916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd933bb-10b4-49c4-ac2a-c00887bd5e4c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.539911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.540548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.540850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.541115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.545989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:33.571146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1174/2374] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:55:33 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:55:33.575104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.585338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fe121-a7d8-4fce-baa0-3b9f92197cc0 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.590169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.590767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.591047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.591329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.591973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.593740 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.603088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.603671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1175/2375] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:55:33.605362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.609161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.614843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1201/2376] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:55:33.618952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273b00e-3f41-4f78-b085-b7e8235fc169 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.623729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.624417 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.624704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.624984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] PATH_INFO: `/v3/projects/95cdbee664564cf895418ffa848df2c9/users/7314fc2a4ac4487791a2058bc30b9d42/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.641504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cdbee664564cf895418ffa848df2c9, user_id=7314fc2a4ac4487791a2058bc30b9d42, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.644137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.725574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1176/2377] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:55:33 2022] PUT /identity/v3/projects/95cdbee664564cf895418ffa848df2c9/users/7314fc2a4ac4487791a2058bc30b9d42/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:33.729710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.740090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115059-896a-4a98-ae8a-1c92e572a7a1 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.776139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:33.803190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bc98a-28a7-47a2-88be-df013bc2a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.803794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bc98a-28a7-47a2-88be-df013bc2a586 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.804075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bc98a-28a7-47a2-88be-df013bc2a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.804386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bc98a-28a7-47a2-88be-df013bc2a586 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.805019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bc98a-28a7-47a2-88be-df013bc2a586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.806658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bc98a-28a7-47a2-88be-df013bc2a586 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.816079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1202/2378] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:33.821043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.831446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b9154-3681-4cd7-ab4f-b69e9cb9be4e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:33.836960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:33.837603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.837889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.838170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] PATH_INFO: `/v3/projects/95cdbee664564cf895418ffa848df2c9/users/7314fc2a4ac4487791a2058bc30b9d42/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.840077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cdbee664564cf895418ffa848df2c9, user_id=7314fc2a4ac4487791a2058bc30b9d42, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:33.842728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:33.853334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1177/2379] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:55:33 2022] PUT /identity/v3/projects/95cdbee664564cf895418ffa848df2c9/users/7314fc2a4ac4487791a2058bc30b9d42/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:33.863468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:33.863780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:33.864540 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:33.893748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] MFA Rules not processed for user `7314fc2a4ac4487791a2058bc30b9d42`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:33.894870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:33.963783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1203/2380] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:33.974900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:33.977198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:34.034652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408750c4-784a-4ad3-ad70-a6748498ddb6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:34.039000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf6f04-64e4-41ad-a835-418b46967700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:34.039614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf6f04-64e4-41ad-a835-418b46967700 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:34.039903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf6f04-64e4-41ad-a835-418b46967700 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:34.040184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf6f04-64e4-41ad-a835-418b46967700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:34.060523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:34.097039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf6f04-64e4-41ad-a835-418b46967700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:34.098481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf6f04-64e4-41ad-a835-418b46967700 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:34.109082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1178/2381] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:37.374091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:37.375506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:37.387631 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7edfb-7624-42e8-868a-553752000d0f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:37.391197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:37.391818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:37.392118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:37.392423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:37.401259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:37.402671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:37.411920 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1204/2382] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:44.170446 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=17 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:45.579842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:45.580438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:45.580438 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:45.600128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:45.601360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:45.656996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1179/2383] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:55:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:45.787902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:45.789519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:45.862447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd9b77-463d-4683-805c-5d341dc14be1 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:45.868544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:45.869722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:45.870083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:45.870587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:45.879550 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:45.881407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:45.890798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1205/2384] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:55:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 22 05:55:50.120720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:50.122493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:50.276550 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1fcfd9-d51c-48b9-8de6-e9675dd82f95 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:50.298627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb4ca1-825f-46dd-9856-24550f63e2fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:50.299752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4ca1-825f-46dd-9856-24550f63e2fa service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:50.299998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4ca1-825f-46dd-9856-24550f63e2fa service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:50.300479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb4ca1-825f-46dd-9856-24550f63e2fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:50.302667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-12eb4ca1-825f-46dd-9856-24550f63e2fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:50.320256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb4ca1-825f-46dd-9856-24550f63e2fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:50.322824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb4ca1-825f-46dd-9856-24550f63e2fa service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:50.352789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1180/2385] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:52.701306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:52.747480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:52.779419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192731d-7949-4a23-acf0-bf2cbbc9685b service swift] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:52.784353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:52.785118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:52.785417 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:52.785700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] PATH_INFO: `/v3/users/1df5400f4f88471cb5ea3b5f1de03d95` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:52.786890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df5400f4f88471cb5ea3b5f1de03d95)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:52.789073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:53.356291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df5400f4f88471cb5ea3b5f1de03d95'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:53.356973 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df5400f4f88471cb5ea3b5f1de03d95'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:53.359838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df5400f4f88471cb5ea3b5f1de03d95'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:53.399394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df5400f4f88471cb5ea3b5f1de03d95'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:53.492571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df5400f4f88471cb5ea3b5f1de03d95'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:53.513669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1206/2386] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:55:52 2022] DELETE /identity/v3/users/1df5400f4f88471cb5ea3b5f1de03d95 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:53.518059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:53.518588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:53.518875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:53.548340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:53.548340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:53.638570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1181/2387] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:53.645542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:53.647153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:53.720162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3595930-8c02-4ce6-af52-a2ec5284545b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:53.731536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:53.732501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:53.733052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:53.733614 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:53.752348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:53.754118 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:53.765676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1207/2388] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:54.617503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:54.619191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:54.648339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887c49b-1764-432d-be82-ea968e598bfb None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:54.648981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:54.649701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:54.650208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:54.650589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] PATH_INFO: `/v3/projects/afd4c5a8ff164f4584c8dc01ad4cb325` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:54.651951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd4c5a8ff164f4584c8dc01ad4cb325)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:54.662174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:54.822639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:54.842500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd4c5a8ff164f4584c8dc01ad4cb325', 'request_id': 'req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:54.849388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd4c5a8ff164f4584c8dc01ad4cb325', 'request_id': 'req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:54.857795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd4c5a8ff164f4584c8dc01ad4cb325', 'request_id': 'req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:54.927063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] The token cache is being invalidate because project afd4c5a8ff164f4584c8dc01ad4cb325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:55:54.927269 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:54.927942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:54.932237 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1182/2389] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:55:54 2022] DELETE /identity/v3/projects/afd4c5a8ff164f4584c8dc01ad4cb325 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:54.936575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:54.947082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232963a3-500d-4f4c-85df-ceb393ad5daf service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:55.009354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:55.021773 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:55.022895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:55.023401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:55.023860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] PATH_INFO: `/v3/users/7314fc2a4ac4487791a2058bc30b9d42` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:55.025501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7314fc2a4ac4487791a2058bc30b9d42)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:55.031273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:55.240595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7314fc2a4ac4487791a2058bc30b9d42'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:55.241541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7314fc2a4ac4487791a2058bc30b9d42'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:55.242443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7314fc2a4ac4487791a2058bc30b9d42'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:55.261680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7314fc2a4ac4487791a2058bc30b9d42'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:55.337053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b5499a98-669a-4189-a709-df6e73b25400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7314fc2a4ac4487791a2058bc30b9d42'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:55.358641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1208/2390] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:55:54 2022] DELETE /identity/v3/users/7314fc2a4ac4487791a2058bc30b9d42 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:55:55.816315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:55.817765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:55.879781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e4e0f2-a864-4fb2-8ea5-7e9e5fc5d010 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:55.979662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:55.980492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:55.980843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:55.981221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] PATH_INFO: `/v3/projects/95cdbee664564cf895418ffa848df2c9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:55.982804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cdbee664564cf895418ffa848df2c9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:55.985027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:56.276236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cdbee664564cf895418ffa848df2c9', 'request_id': 'req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:56.283203 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cdbee664564cf895418ffa848df2c9', 'request_id': 'req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:56.297135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cdbee664564cf895418ffa848df2c9', 'request_id': 'req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:56.445286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] The token cache is being invalidate because project 95cdbee664564cf895418ffa848df2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:55:56.453297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:56.453297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-51c2fb34-4fc9-4ce3-a69d-0194d1c954b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:55:56.453297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1183/2391] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:55:55 2022] DELETE /identity/v3/projects/95cdbee664564cf895418ffa848df2c9 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:56.453842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9380-5cc9-413f-a888-1eced9da8786 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:56.454296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9380-5cc9-413f-a888-1eced9da8786 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:56.454398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c9380-5cc9-413f-a888-1eced9da8786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:56.475736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c95c9380-5cc9-413f-a888-1eced9da8786 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:56.476998 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c95c9380-5cc9-413f-a888-1eced9da8786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:56.538717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1209/2392] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:56.547092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151d97-140b-466b-b04f-04dc42567c0a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:56.547381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151d97-140b-466b-b04f-04dc42567c0a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:56.547662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151d97-140b-466b-b04f-04dc42567c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:56.569419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-87151d97-140b-466b-b04f-04dc42567c0a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:56.579491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-87151d97-140b-466b-b04f-04dc42567c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:56.579491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1184/2393] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:56.584179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9380-5cc9-413f-a888-1eced9da8786 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:56.594883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c9380-5cc9-413f-a888-1eced9da8786 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:56.599450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:56.600047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:56.600367 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:56.600646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:56.601298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:55:56.601606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:56.603249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:56.617254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1210/2394] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:55:56.623610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151d97-140b-466b-b04f-04dc42567c0a None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:56.633078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87151d97-140b-466b-b04f-04dc42567c0a None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:56.638531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:56.639162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:56.639459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:56.639727 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:56.640392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:56.642383 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:56.770267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1185/2395] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:55:56 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:55:56.774533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:56.785221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea3da7-d119-4e37-888c-f6ac330a7b35 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:56.834487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:56.841415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:56.842016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:56.843580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:56.843580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:56.843580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:56.845136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:56.946313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1211/2396] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:55:56 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:55:56.947543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:56.959728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518c3b8-d7fb-4566-9743-d79f5ce7d6c9 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:56.965699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:56.967139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:56.967139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:56.967139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:56.967985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:56.969861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:56.982705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1186/2397] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:56.985450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:56.997825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3044e29-4aa8-4c80-8e8b-f9d6f8ed10e5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:57.005285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef686c-538a-4500-82af-aba33216062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:57.006217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef686c-538a-4500-82af-aba33216062a admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:57.006584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef686c-538a-4500-82af-aba33216062a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:57.006923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef686c-538a-4500-82af-aba33216062a admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:57.007646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef686c-538a-4500-82af-aba33216062a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:57.009364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef686c-538a-4500-82af-aba33216062a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:57.026393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1212/2398] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:55:57.030209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:57.037309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:57.043517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a68c87-be43-4762-b560-c13257229089 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:57.050488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:57.052352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:57.052352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:57.052352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] PATH_INFO: `/v3/projects/f97dc102b5f640ef9945c56f167b92d6/users/ab9abbb0208e4662afaaff2e1344deff/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:57.077146 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97dc102b5f640ef9945c56f167b92d6, user_id=ab9abbb0208e4662afaaff2e1344deff, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:57.080117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:57.161159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1187/2399] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:55:57 2022] PUT /identity/v3/projects/f97dc102b5f640ef9945c56f167b92d6/users/ab9abbb0208e4662afaaff2e1344deff/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:55:57.162579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:57.162869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:57.163146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:57.185010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:57.186222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:57.308522 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:57.310699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:57.320087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1213/2400] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:55:57.329842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:57.332402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:57.383278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c6696-08bb-4b04-8800-dc8584f063d1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:57.387987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:57.388815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:57.389289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:57.389618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:57.391467 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:57.402235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e9b53-8dc9-4fdf-983f-820fbf2f21cb None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:57.407191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d492-da77-4527-bed6-16d5cf42aca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:57.407815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d492-da77-4527-bed6-16d5cf42aca5 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:57.407954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:57.408124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d492-da77-4527-bed6-16d5cf42aca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:57.408398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d492-da77-4527-bed6-16d5cf42aca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:57.409636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:57.418376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1d492-da77-4527-bed6-16d5cf42aca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:57.419806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1d492-da77-4527-bed6-16d5cf42aca5 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:57.421016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1188/2401] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:55:57.438095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1214/2402] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:55:58.842134 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:58.843651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:58.863519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac8e2-b160-483a-b5fa-de9503520b70 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:58.868497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:58.868497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:58.868695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:58.869060 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:58.871330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:58.893930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:58.897562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:58.905947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1189/2403] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:55:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:55:59.614478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ba108-0ee6-4c48-933f-4415832b4697 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:59.615076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ba108-0ee6-4c48-933f-4415832b4697 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:59.615076 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ba108-0ee6-4c48-933f-4415832b4697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:59.647863 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5f0ba108-0ee6-4c48-933f-4415832b4697 None None] MFA Rules not processed for user `ab9abbb0208e4662afaaff2e1344deff`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:55:59.649413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5f0ba108-0ee6-4c48-933f-4415832b4697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:55:59.735627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1215/2404] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:55:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:55:59.740006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:59.757504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2b1b1-d543-46af-a4a6-837f2f6b2e51 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:59.772943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:59.773574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:59.773858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:59.774137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:59.775084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:59.778025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:55:59.868593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1190/2405] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:55:59 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:55:59.869223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ba108-0ee6-4c48-933f-4415832b4697 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:55:59.886316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ba108-0ee6-4c48-933f-4415832b4697 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:55:59.914824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:55:59.992459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:55:59.993177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:55:59.993534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:55:59.993915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:55:59.994648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:55:59.997344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:00.112694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1216/2406] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:55:59 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:00.116765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:00.129302 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814debda-0341-4fa5-afd4-622aec14b322 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:00.135007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:00.136288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:00.136793 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:00.137175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:00.138025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:00.140188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:00.159858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1191/2407] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:00.163053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:00.173518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1807997-c5a7-43fa-a039-340e7d4eba63 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:00.178811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:00.182934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:00.182934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:00.182934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] PATH_INFO: `/v3/projects/9a9ee0bbd9934e38a7b970b3d20aee53/users/c17059674e2a42c6a149c8d9ead89770/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:00.198581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9ee0bbd9934e38a7b970b3d20aee53, user_id=c17059674e2a42c6a149c8d9ead89770, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:00.201996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:00.305137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1217/2408] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:00 2022] PUT /identity/v3/projects/9a9ee0bbd9934e38a7b970b3d20aee53/users/c17059674e2a42c6a149c8d9ead89770/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:00.307749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:00.319767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d752e-e40f-4107-aac9-3eab214abc4b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:00.386950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:00.390704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:00.391005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:00.391297 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:00.392093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:00.393841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:00.404494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1192/2409] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:00.408754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:00.419938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfae0a-98a3-45ec-b0f1-85ebab6bf474 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:00.424624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:00.425275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:00.425557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:00.429494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] PATH_INFO: `/v3/projects/9a9ee0bbd9934e38a7b970b3d20aee53/users/c17059674e2a42c6a149c8d9ead89770/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:00.429494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9ee0bbd9934e38a7b970b3d20aee53, user_id=c17059674e2a42c6a149c8d9ead89770, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:00.430387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:00.441199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1218/2410] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:00 2022] PUT /identity/v3/projects/9a9ee0bbd9934e38a7b970b3d20aee53/users/c17059674e2a42c6a149c8d9ead89770/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:02.007631 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:02.009795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:02.055635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:02.100633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6cab6-907b-4cf9-9966-d7aef92211fb admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:02.179279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c12a7-e525-46d9-a791-c62f0231eb55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:02.179911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c12a7-e525-46d9-a791-c62f0231eb55 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:02.180221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c12a7-e525-46d9-a791-c62f0231eb55 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:02.180536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c12a7-e525-46d9-a791-c62f0231eb55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:02.183440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-788c12a7-e525-46d9-a791-c62f0231eb55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:02.195967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c12a7-e525-46d9-a791-c62f0231eb55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:02.197614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c12a7-e525-46d9-a791-c62f0231eb55 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:02.210274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1193/2411] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:02.223911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:02.224681 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83ecf-8a0f-4462-84f1-3fb080629f59 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:02.225154 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83ecf-8a0f-4462-84f1-3fb080629f59 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:02.225596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83ecf-8a0f-4462-84f1-3fb080629f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:02.229095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:02.274654 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-22f83ecf-8a0f-4462-84f1-3fb080629f59 None None] MFA Rules not processed for user `c17059674e2a42c6a149c8d9ead89770`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:02.276380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-22f83ecf-8a0f-4462-84f1-3fb080629f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:02.389699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8478ad7-ecc1-41eb-9752-dfe4ab0788cb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:02.395936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1194/2412] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:02.406788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:02.407360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b16155-9409-48ee-9deb-65eeb4264279 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:02.407504 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:02.407712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:02.407819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b16155-9409-48ee-9deb-65eeb4264279 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:02.407992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] PATH_INFO: `/v3/users/3c3e9dcf324348a595fdd62d901b8a93` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:02.408095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b16155-9409-48ee-9deb-65eeb4264279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:02.409193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c3e9dcf324348a595fdd62d901b8a93)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:02.411314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:02.443268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-88b16155-9409-48ee-9deb-65eeb4264279 None None] MFA Rules not processed for user `ab9abbb0208e4662afaaff2e1344deff`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:02.445827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-88b16155-9409-48ee-9deb-65eeb4264279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:02.531520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1195/2413] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:02.603208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c3e9dcf324348a595fdd62d901b8a93'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:02.604099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c3e9dcf324348a595fdd62d901b8a93'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:02.604844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c3e9dcf324348a595fdd62d901b8a93'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:02.613016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:02.621993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:02.623258 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c3e9dcf324348a595fdd62d901b8a93'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:02.675305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c3e9dcf324348a595fdd62d901b8a93'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:02.688747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1219/2414] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:02 2022] DELETE /identity/v3/users/3c3e9dcf324348a595fdd62d901b8a93 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:02.707551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b16155-9409-48ee-9deb-65eeb4264279 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:02.721551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b16155-9409-48ee-9deb-65eeb4264279 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:02.785696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:02.786215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:02.786502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:02.786785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:02.789578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:02.848934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:02.850601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:02.860437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1196/2415] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:02.953033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:02.954479 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:03.026768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449800-f855-4eb4-8c3e-83dbe8f82f26 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.031773 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.032445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.032760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.033043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] PATH_INFO: `/v3/projects/6507f60617534696af0978be0b8ef546` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.034189 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6507f60617534696af0978be0b8ef546)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.036226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.127695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.129338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:03.148688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6507f60617534696af0978be0b8ef546', 'request_id': 'req-d761a89e-a5aa-4328-97b8-54f6edd667b5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:03.157218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6507f60617534696af0978be0b8ef546', 'request_id': 'req-d761a89e-a5aa-4328-97b8-54f6edd667b5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:03.194906 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582698e-6b08-4394-a923-7485ac8ba2f6 service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.233257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:03.244077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e70ada-c470-4c0c-bcaf-856373136624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.245223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6507f60617534696af0978be0b8ef546', 'request_id': 'req-d761a89e-a5aa-4328-97b8-54f6edd667b5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:03.245698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70ada-c470-4c0c-bcaf-856373136624 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.245698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70ada-c470-4c0c-bcaf-856373136624 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.245898 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70ada-c470-4c0c-bcaf-856373136624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.248551 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-57e70ada-c470-4c0c-bcaf-856373136624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:03.258397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e70ada-c470-4c0c-bcaf-856373136624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.259956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] The token cache is being invalidate because project 6507f60617534696af0978be0b8ef546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:03.260171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e70ada-c470-4c0c-bcaf-856373136624 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.260375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:03.261280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d761a89e-a5aa-4328-97b8-54f6edd667b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:03.263305 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1220/2416] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:02 2022] DELETE /identity/v3/projects/6507f60617534696af0978be0b8ef546 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:03.268432 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09e61-a912-4c32-8c23-65687b5c6112 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.268914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09e61-a912-4c32-8c23-65687b5c6112 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.269450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f09e61-a912-4c32-8c23-65687b5c6112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.273304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1197/2417] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:03.291653 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-87f09e61-a912-4c32-8c23-65687b5c6112 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:03.293656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-87f09e61-a912-4c32-8c23-65687b5c6112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:03.363530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc157fd-8685-475b-ac60-8749c13bf887 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.363897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc157fd-8685-475b-ac60-8749c13bf887 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.364173 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc157fd-8685-475b-ac60-8749c13bf887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.367752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1221/2418] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:03.383955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-dfc157fd-8685-475b-ac60-8749c13bf887 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:03.385224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-dfc157fd-8685-475b-ac60-8749c13bf887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:03.394918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1198/2419] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:03.399186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09e61-a912-4c32-8c23-65687b5c6112 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.410488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f09e61-a912-4c32-8c23-65687b5c6112 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.415275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.415886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.416164 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.416477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.417156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:03.417462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.419064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.428912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:03.432496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1222/2420] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:56:03.443204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc157fd-8685-475b-ac60-8749c13bf887 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.456365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc157fd-8685-475b-ac60-8749c13bf887 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.462147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.464095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.464095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.464095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.464937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.467418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.579135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1199/2421] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:03 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:03.583226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.593315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a1d45-a8a7-4d82-a2d3-7a3bc43ea1a9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.652538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.653154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.653434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.653709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.654364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.656309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.797379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.799533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1223/2422] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:03 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:03.800386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:03.811717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.824633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88915f34-56fb-43c9-933b-1dc205e947c7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.840154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.842297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.842297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.842297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.842857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.844606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.859463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1224/2423] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:03.868412 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.884152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36500ca0-2345-46f3-93c1-2f02ccdc3703 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.896347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.897186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.897632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.898054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.898882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.900678 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.918935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1225/2424] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:03.924607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:03.927713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634819a-ed23-4438-b55a-19470008679d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.947331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c39d1c-a83b-4428-8545-82e1c0829dc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.954885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c9645-aee9-4e75-ad53-fcd24ab42e6b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:03.955027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39d1c-a83b-4428-8545-82e1c0829dc1 service placement] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.955027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39d1c-a83b-4428-8545-82e1c0829dc1 service placement] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.955027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c39d1c-a83b-4428-8545-82e1c0829dc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.955027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d6c39d1c-a83b-4428-8545-82e1c0829dc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:03.957919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:03.959072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:03.959406 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:03.959751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] PATH_INFO: `/v3/projects/981e0ca2e37c4958b792cf59351a212b/users/5693dcee646e448fa43275dd5375ad41/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:03.979846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39d1c-a83b-4428-8545-82e1c0829dc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:03.981045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c39d1c-a83b-4428-8545-82e1c0829dc1 service placement] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:03.998956 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1200/2425] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:56:04.013219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] RBAC: Authorizing `identity:create_grant(project_id=981e0ca2e37c4958b792cf59351a212b, user_id=5693dcee646e448fa43275dd5375ad41, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:04.018399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:04.139235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1226/2426] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:03 2022] PUT /identity/v3/projects/981e0ca2e37c4958b792cf59351a212b/users/5693dcee646e448fa43275dd5375ad41/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:04.149156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85389-f9f7-41fa-9577-35cf66af8206 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:04.149691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85389-f9f7-41fa-9577-35cf66af8206 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:04.149816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c85389-f9f7-41fa-9577-35cf66af8206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:04.178684 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a0c85389-f9f7-41fa-9577-35cf66af8206 None None] MFA Rules not processed for user `5693dcee646e448fa43275dd5375ad41`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:04.179905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a0c85389-f9f7-41fa-9577-35cf66af8206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:04.250312 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1201/2427] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:04.262641 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:04.264475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:04.341563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbba8f-22b4-494f-8476-8a53e78e275f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:04.347526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a349e07-36fe-45ba-bd09-b63df38155eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:04.348142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349e07-36fe-45ba-bd09-b63df38155eb service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:04.348463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349e07-36fe-45ba-bd09-b63df38155eb service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:04.348746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a349e07-36fe-45ba-bd09-b63df38155eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:04.356754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a349e07-36fe-45ba-bd09-b63df38155eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:04.358898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a349e07-36fe-45ba-bd09-b63df38155eb service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:04.368974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1227/2428] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:04.599644 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85389-f9f7-41fa-9577-35cf66af8206 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:04.633848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:04.662081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c85389-f9f7-41fa-9577-35cf66af8206 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:04.666613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:04.667201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:04.667825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:04.668369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] PATH_INFO: `/v3/users/5693dcee646e448fa43275dd5375ad41` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:04.670096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5693dcee646e448fa43275dd5375ad41)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:04.672299 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:04.942440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5693dcee646e448fa43275dd5375ad41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:04.943129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5693dcee646e448fa43275dd5375ad41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:04.943814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5693dcee646e448fa43275dd5375ad41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:04.954238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5693dcee646e448fa43275dd5375ad41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:05.012381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5693dcee646e448fa43275dd5375ad41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:05.031248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1202/2429] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:04 2022] DELETE /identity/v3/users/5693dcee646e448fa43275dd5375ad41 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:05.035938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:05.036443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:05.036977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:05.063093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:05.064403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:05.084783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:05.128348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1228/2430] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:05.139627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:05.141436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:05.212502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafa04-3d07-40e8-b44f-f8481c7c38cc admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:05.232215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22446c6-d4b4-4ae4-9e2e-c3261dbf341a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:05.232974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22446c6-d4b4-4ae4-9e2e-c3261dbf341a service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:05.233352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22446c6-d4b4-4ae4-9e2e-c3261dbf341a service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:05.233725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22446c6-d4b4-4ae4-9e2e-c3261dbf341a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:05.244104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22446c6-d4b4-4ae4-9e2e-c3261dbf341a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:05.246828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22446c6-d4b4-4ae4-9e2e-c3261dbf341a service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:05.270160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1203/2431] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:05.757519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:05.761579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:05.777155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4498-8df6-43e7-83a8-cf7f4a69a0d4 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:05.801047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:05.802872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:05.803370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:05.803985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] PATH_INFO: `/v3/projects/981e0ca2e37c4958b792cf59351a212b` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:05.819055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=981e0ca2e37c4958b792cf59351a212b)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:05.825850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:06.037410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981e0ca2e37c4958b792cf59351a212b', 'request_id': 'req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:06.056734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981e0ca2e37c4958b792cf59351a212b', 'request_id': 'req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:06.161191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981e0ca2e37c4958b792cf59351a212b', 'request_id': 'req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:06.172296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] The token cache is being invalidate because project 981e0ca2e37c4958b792cf59351a212b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:06.172592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:06.173280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8cdecbd5-0a0a-4c0d-baf0-0fe12209f7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:06.174853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1229/2432] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:05 2022] DELETE /identity/v3/projects/981e0ca2e37c4958b792cf59351a212b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:06.179772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8cab-4ab4-42aa-a680-a78195ae92c4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.180066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8cab-4ab4-42aa-a680-a78195ae92c4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.180400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe8cab-4ab4-42aa-a680-a78195ae92c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.201519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-79fe8cab-4ab4-42aa-a680-a78195ae92c4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:06.202736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-79fe8cab-4ab4-42aa-a680-a78195ae92c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:06.289486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:06.309359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1204/2433] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:06.318154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e87645-08d7-4de5-919e-4aab47f41850 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.318430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e87645-08d7-4de5-919e-4aab47f41850 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.318714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e87645-08d7-4de5-919e-4aab47f41850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.339609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d8e87645-08d7-4de5-919e-4aab47f41850 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:06.344324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d8e87645-08d7-4de5-919e-4aab47f41850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:06.349128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1230/2434] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:06.353417 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8cab-4ab4-42aa-a680-a78195ae92c4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:06.366340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe8cab-4ab4-42aa-a680-a78195ae92c4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:06.372131 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:06.372804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.373094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.373381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.374054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:06.374372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:06.375984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:06.388846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1205/2435] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:56:06.394421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e87645-08d7-4de5-919e-4aab47f41850 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:06.404031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e87645-08d7-4de5-919e-4aab47f41850 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:06.409060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c27956-1b6c-44af-80bd-9ea3c9455791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:06.409670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27956-1b6c-44af-80bd-9ea3c9455791 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.409958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27956-1b6c-44af-80bd-9ea3c9455791 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.410239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27956-1b6c-44af-80bd-9ea3c9455791 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.410875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c27956-1b6c-44af-80bd-9ea3c9455791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:06.412978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c27956-1b6c-44af-80bd-9ea3c9455791 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:06.549785 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1231/2436] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:06 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:06.554137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:06.574445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f296bfc-a2d3-4260-847b-f7fbd762c51d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:06.620490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d106c63-39c5-44dc-98d9-859e6f17db65 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.621215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d106c63-39c5-44dc-98d9-859e6f17db65 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.621495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d106c63-39c5-44dc-98d9-859e6f17db65 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.623122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1232/2437] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:56:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:56:06.628810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.634843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.634843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.663056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:06.665366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:06.717585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:06.718372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.718794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.719179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.719925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:06.723568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:06.762918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1233/2438] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:56:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:06.775513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:06.777645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:06.791496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:06.825430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1206/2439] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:06 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:06.829498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:06.837465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7dfbf9-b872-489c-950b-55fa4d4a8d0e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:06.840884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f7bf0-1c4d-4369-934f-563237552313 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:06.841418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:06.842032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.842326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.842605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.847043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:06.847641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.847925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.848226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.848882 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:06.854308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:06.855442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:06.857885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:06.865698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1207/2440] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:06.867076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:06.873743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1234/2441] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:56:06.879962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219648-e82d-4774-9741-4c7a213e7cad admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:06.885168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125683aa-2f24-4283-90f0-01c7c442ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:06.886350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125683aa-2f24-4283-90f0-01c7c442ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.886639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125683aa-2f24-4283-90f0-01c7c442ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.886923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125683aa-2f24-4283-90f0-01c7c442ab14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.887574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125683aa-2f24-4283-90f0-01c7c442ab14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:06.889248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125683aa-2f24-4283-90f0-01c7c442ab14 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:06.900512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1208/2442] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:06.904684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:06.924225 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973a29c-faae-4cba-aee2-d64f35d24de3 service glance] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:06.929674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2630034-df23-4a2d-b414-2daff4e1caec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:06.930341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2630034-df23-4a2d-b414-2daff4e1caec admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:06.930684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2630034-df23-4a2d-b414-2daff4e1caec admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:06.930942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2630034-df23-4a2d-b414-2daff4e1caec admin admin] PATH_INFO: `/v3/projects/6bfe2763929f4d8c8c840f6a87214974/users/a499c299b16f4b99802846a26b213e22/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:06.950777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2630034-df23-4a2d-b414-2daff4e1caec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bfe2763929f4d8c8c840f6a87214974, user_id=a499c299b16f4b99802846a26b213e22, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:06.953532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2630034-df23-4a2d-b414-2daff4e1caec admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.056728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1235/2443] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:06 2022] PUT /identity/v3/projects/6bfe2763929f4d8c8c840f6a87214974/users/a499c299b16f4b99802846a26b213e22/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:07.068039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775e457-0c55-42cd-8462-966a83747d6e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.068658 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775e457-0c55-42cd-8462-966a83747d6e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.069090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775e457-0c55-42cd-8462-966a83747d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.113791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a775e457-0c55-42cd-8462-966a83747d6e None None] MFA Rules not processed for user `a499c299b16f4b99802846a26b213e22`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:07.113791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a775e457-0c55-42cd-8462-966a83747d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:07.151618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3a83-1715-4806-99bd-e29411f4d0f4 None None] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.151958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3a83-1715-4806-99bd-e29411f4d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.152183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c3a83-1715-4806-99bd-e29411f4d0f4 None None] PATH_INFO: `/` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.153547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1236/2444] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 22 05:56:07.169901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.170323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.171061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.198666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1209/2445] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:07.203420 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775e457-0c55-42cd-8462-966a83747d6e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.220100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] MFA Rules not processed for user `2d46d5905b004073b10e694ab79e7187`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:07.223351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:07.262858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:07.285503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775e457-0c55-42cd-8462-966a83747d6e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.292936 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c3218-1cc3-4ce4-af9b-9222da9ae606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.293564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c3218-1cc3-4ce4-af9b-9222da9ae606 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.293854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c3218-1cc3-4ce4-af9b-9222da9ae606 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.294137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c3218-1cc3-4ce4-af9b-9222da9ae606 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.294781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c3218-1cc3-4ce4-af9b-9222da9ae606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:07.296756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c3218-1cc3-4ce4-af9b-9222da9ae606 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.300500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1237/2446] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:56:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:07.313481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.314902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:07.325267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696156f7-6569-42b3-b67c-f1dae7c6693d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.328936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.329527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.329806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.330128 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.338323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:07.339860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.348749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1238/2447] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:07.415452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1210/2448] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:07 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:07.420070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.433268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de16180-d3bb-41e7-906b-1b16e7d60bc9 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.442773 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd49554-6458-411e-abf9-5e7cf56c9c76 None None] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.443260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd49554-6458-411e-abf9-5e7cf56c9c76 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.443594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd49554-6458-411e-abf9-5e7cf56c9c76 None None] PATH_INFO: `/` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.445059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1211/2449] 10.222.0.27 () {54 vars in 921 bytes} [Mon Aug 22 05:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 22 05:56:07.450791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138eca7-f346-4394-94ff-a4908eb51191 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.451353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138eca7-f346-4394-94ff-a4908eb51191 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.451868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138eca7-f346-4394-94ff-a4908eb51191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.472379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-8138eca7-f346-4394-94ff-a4908eb51191 None None] MFA Rules not processed for user `344aa2356f0c4d8fb88e7c35603a65c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:07.473732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8138eca7-f346-4394-94ff-a4908eb51191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:07.504431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.505053 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.505434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.505794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.506507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:07.508617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.552556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1212/2450] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Aug 22 05:56:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:07.563964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138eca7-f346-4394-94ff-a4908eb51191 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.598780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1239/2451] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:07 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:07.602301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.641000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cede7-1196-4536-be94-81a69e43ff5c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.649846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.650625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.651867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.652373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.654069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:07.657751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.673274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1240/2452] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:07.683137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138eca7-f346-4394-94ff-a4908eb51191 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.686886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.694704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.695345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.695635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.695914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.710185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc29657-359e-4c53-9772-b0bd1157e9dd admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.716219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.717553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.718240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.718240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] PATH_INFO: `/v3/projects/ed2e60d2e1754b778098f2e444bf8714/users/c5ca99ff1ebe49248ea712ce66304647/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.720911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:07.727078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:07.728826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.739507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2e60d2e1754b778098f2e444bf8714, user_id=c5ca99ff1ebe49248ea712ce66304647, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:07.744283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.744590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1213/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:56:07.836114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1241/2454] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:07 2022] PUT /identity/v3/projects/ed2e60d2e1754b778098f2e444bf8714/users/c5ca99ff1ebe49248ea712ce66304647/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:07.838307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.849283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e789a2-9b26-4199-a67a-72aaf4da152c service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.937949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e164a-cdfb-4620-b692-6dce22bcb8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.938780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e164a-cdfb-4620-b692-6dce22bcb8db admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.939127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e164a-cdfb-4620-b692-6dce22bcb8db admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:07.939714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e164a-cdfb-4620-b692-6dce22bcb8db admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:07.946479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e164a-cdfb-4620-b692-6dce22bcb8db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:07.948991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e164a-cdfb-4620-b692-6dce22bcb8db admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:07.951156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:07.973801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1214/2455] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:07.974921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:07.987564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7e42f-4bec-490a-9974-349bd7b1eb25 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:07.998459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:07.999297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:07.999688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:08.000073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] PATH_INFO: `/v3/projects/ed2e60d2e1754b778098f2e444bf8714/users/c5ca99ff1ebe49248ea712ce66304647/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:08.005987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2e60d2e1754b778098f2e444bf8714, user_id=c5ca99ff1ebe49248ea712ce66304647, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:08.009030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:08.020781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1242/2456] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:07 2022] PUT /identity/v3/projects/ed2e60d2e1754b778098f2e444bf8714/users/c5ca99ff1ebe49248ea712ce66304647/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:08.031637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da214-2f80-4006-84dd-62abc424ced1 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:08.031926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da214-2f80-4006-84dd-62abc424ced1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:08.032220 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7da214-2f80-4006-84dd-62abc424ced1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:08.060934 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ca7da214-2f80-4006-84dd-62abc424ced1 None None] MFA Rules not processed for user `c5ca99ff1ebe49248ea712ce66304647`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:08.062139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ca7da214-2f80-4006-84dd-62abc424ced1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:08.160771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1215/2457] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:08.173368 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:08.175634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:08.260223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92c78f-2946-4849-a3cb-171d0fc0e0a3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:08.260223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9fbac-b243-40f0-905f-83fde00fab70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:08.260223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9fbac-b243-40f0-905f-83fde00fab70 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:08.260223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9fbac-b243-40f0-905f-83fde00fab70 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:08.261366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9fbac-b243-40f0-905f-83fde00fab70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:08.281033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9fbac-b243-40f0-905f-83fde00fab70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:08.288593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9fbac-b243-40f0-905f-83fde00fab70 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:08.313693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1243/2458] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:08.368069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da214-2f80-4006-84dd-62abc424ced1 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:08.436266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7da214-2f80-4006-84dd-62abc424ced1 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:08.441180 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:08.441855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:08.442143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:08.442429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] PATH_INFO: `/v3/users/a499c299b16f4b99802846a26b213e22` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:08.443603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a499c299b16f4b99802846a26b213e22)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:08.445633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:08.628389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a499c299b16f4b99802846a26b213e22'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:08.629074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a499c299b16f4b99802846a26b213e22'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:08.630100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a499c299b16f4b99802846a26b213e22'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:08.638570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a499c299b16f4b99802846a26b213e22'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:08.698694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a499c299b16f4b99802846a26b213e22'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:08.720229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:08.728140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1216/2459] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:08 2022] DELETE /identity/v3/users/a499c299b16f4b99802846a26b213e22 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:08.730340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:08.733137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:08.733137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:08.751002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:08.752280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:08.810890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1244/2460] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:08.820470 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:08.828353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:08.879540 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c79f2e-f326-4b64-9ae6-a95f7d24dbe1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:08.883471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:08.884089 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:08.884396 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:08.884671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:08.893792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:08.895239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:08.905094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1217/2461] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:09.431723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:09.433234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:09.445541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d117ae0-d782-44c3-8e5a-d7e2314ce024 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:09.450853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:09.451520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:09.451817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:09.452097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] PATH_INFO: `/v3/projects/6bfe2763929f4d8c8c840f6a87214974` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:09.453299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bfe2763929f4d8c8c840f6a87214974)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:09.455883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:09.607608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bfe2763929f4d8c8c840f6a87214974', 'request_id': 'req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:09.614845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bfe2763929f4d8c8c840f6a87214974', 'request_id': 'req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:09.716057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bfe2763929f4d8c8c840f6a87214974', 'request_id': 'req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:09.723710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:09.730499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] The token cache is being invalidate because project 6bfe2763929f4d8c8c840f6a87214974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:09.730880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:09.731871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:09.733483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1245/2462] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:09 2022] DELETE /identity/v3/projects/6bfe2763929f4d8c8c840f6a87214974 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:09.738335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:09.748858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c38ee-5067-4095-84b3-1e6b9a6cf145 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:09.815627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:09.816340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:09.816625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:09.816964 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] PATH_INFO: `/v3/users/c5ca99ff1ebe49248ea712ce66304647` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:09.818080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ca99ff1ebe49248ea712ce66304647)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:09.820032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:10.021481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ca99ff1ebe49248ea712ce66304647'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:10.022150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ca99ff1ebe49248ea712ce66304647'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:10.022754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ca99ff1ebe49248ea712ce66304647'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:10.030760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ca99ff1ebe49248ea712ce66304647'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:10.097188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-05ccddf2-be38-42a7-9cfd-28f0597d1811 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ca99ff1ebe49248ea712ce66304647'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:10.122273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1218/2463] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:09 2022] DELETE /identity/v3/users/c5ca99ff1ebe49248ea712ce66304647 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:10.679791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:10.681282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:10.694430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0ff6-81da-4cff-b9b3-afc2b93339dd admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:10.780423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:10.781489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:10.781874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:10.782254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] PATH_INFO: `/v3/projects/ed2e60d2e1754b778098f2e444bf8714` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:10.783606 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2e60d2e1754b778098f2e444bf8714)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:10.785676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:10.920095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2e60d2e1754b778098f2e444bf8714', 'request_id': 'req-d20c70d8-624c-48d8-bee1-b419777e60e0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:10.923486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2e60d2e1754b778098f2e444bf8714', 'request_id': 'req-d20c70d8-624c-48d8-bee1-b419777e60e0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:10.995577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2e60d2e1754b778098f2e444bf8714', 'request_id': 'req-d20c70d8-624c-48d8-bee1-b419777e60e0'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:11.014827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] The token cache is being invalidate because project ed2e60d2e1754b778098f2e444bf8714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:11.015558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:11.016442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-d20c70d8-624c-48d8-bee1-b419777e60e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:11.019084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1246/2464] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:10 2022] DELETE /identity/v3/projects/ed2e60d2e1754b778098f2e444bf8714 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:11.024912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46344264-1efc-4970-8948-37fe09a5b4f1 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.026553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46344264-1efc-4970-8948-37fe09a5b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.026553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46344264-1efc-4970-8948-37fe09a5b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.047137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-46344264-1efc-4970-8948-37fe09a5b4f1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:11.048485 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-46344264-1efc-4970-8948-37fe09a5b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:11.067473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:11.114150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1219/2465] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:11.121907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab903-a142-4e64-b7a2-7169795bfafc None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.122120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab903-a142-4e64-b7a2-7169795bfafc None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.122317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ab903-a142-4e64-b7a2-7169795bfafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.159795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-595ab903-a142-4e64-b7a2-7169795bfafc None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:11.161334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-595ab903-a142-4e64-b7a2-7169795bfafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:11.169669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1247/2466] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:11.174124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46344264-1efc-4970-8948-37fe09a5b4f1 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.186254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46344264-1efc-4970-8948-37fe09a5b4f1 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.192496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:11.193191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.193476 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.193760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.194558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:11.194879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:11.196519 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:11.215820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1220/2467] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:56:11.219984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab903-a142-4e64-b7a2-7169795bfafc None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.229527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ab903-a142-4e64-b7a2-7169795bfafc None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.235399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:11.236003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.238800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.238800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.238800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:11.239122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:11.330688 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1248/2468] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:11 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:11.334697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.348992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1875f94-8250-4e56-a072-5439df1ffe56 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.433114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:11.433729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.434016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.434285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.434923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:11.437041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:11.493460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1221/2469] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:11 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:11.497595 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.511029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1cd36-a744-468c-8e6e-984a64558068 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.515875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:11.516667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.517029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.517395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.518238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:11.520119 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:11.535950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1249/2470] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:11.537080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.548099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b69e00-ce5e-404d-9a4c-048d9da2a302 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.553141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff1916-ef04-4c7e-a7bb-ad02830848d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:11.553761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff1916-ef04-4c7e-a7bb-ad02830848d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.554040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff1916-ef04-4c7e-a7bb-ad02830848d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.554318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff1916-ef04-4c7e-a7bb-ad02830848d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.554966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff1916-ef04-4c7e-a7bb-ad02830848d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:11.556593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff1916-ef04-4c7e-a7bb-ad02830848d2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:11.569429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1222/2471] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:11.574003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.584349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e09f9-df87-4919-b30d-d8a4bf86f07e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.590051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:11.590713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.590992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.591266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] PATH_INFO: `/v3/projects/8606a5b17f794726b6ec02198faca3a2/users/4719e87ae18848a5a85ff1ba5cfdce80/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.607073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8606a5b17f794726b6ec02198faca3a2, user_id=4719e87ae18848a5a85ff1ba5cfdce80, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:11.609856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:11.671108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1250/2472] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:11 2022] PUT /identity/v3/projects/8606a5b17f794726b6ec02198faca3a2/users/4719e87ae18848a5a85ff1ba5cfdce80/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:11.682484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845b67-4e90-495e-8ac0-49501936dba4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.682897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845b67-4e90-495e-8ac0-49501936dba4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.683341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845b67-4e90-495e-8ac0-49501936dba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.729842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-21845b67-4e90-495e-8ac0-49501936dba4 None None] MFA Rules not processed for user `4719e87ae18848a5a85ff1ba5cfdce80`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:11.729842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-21845b67-4e90-495e-8ac0-49501936dba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:11.787795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1223/2473] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:11.792574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.822072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:11.862946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0d31e-aefb-44c2-b533-1e4a0d98008a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.867823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:11.868535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:11.868822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:11.869100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:11.869864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:11.871777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:11.961106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1251/2474] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:11 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:11.961226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845b67-4e90-495e-8ac0-49501936dba4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:11.972222 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845b67-4e90-495e-8ac0-49501936dba4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:11.990753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:12.051344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:12.052016 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:12.052427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:12.052780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:12.053491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:12.055532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:12.167912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1224/2475] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:11 2022] POST /identity/v3/users => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:12.171997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:12.183161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0dc09-4e32-49bc-9668-0f89bcc502a8 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:12.190003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:12.190558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:12.190842 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:12.191715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:12.192431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:12.194333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:12.206210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1252/2476] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:12.211139 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:12.223622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd066-1dd0-4801-abf4-ba92e94a8435 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:12.244329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:12.245403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:12.245836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:12.246382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] PATH_INFO: `/v3/projects/9be8a4f766914e84bb09ee816f670152/users/06e2aeb2542f420e9cffea9ee9cca556/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:12.273982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be8a4f766914e84bb09ee816f670152, user_id=06e2aeb2542f420e9cffea9ee9cca556, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:12.280920 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:12.402948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1225/2477] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:12 2022] PUT /identity/v3/projects/9be8a4f766914e84bb09ee816f670152/users/06e2aeb2542f420e9cffea9ee9cca556/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:12.406938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:12.416790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d021e7c-d46a-4ebc-ad50-2d61b6c2dd28 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:12.476391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de8850-2429-4bea-a7c7-b123f28223da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:12.476937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8850-2429-4bea-a7c7-b123f28223da admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:12.477220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8850-2429-4bea-a7c7-b123f28223da admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:12.477496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de8850-2429-4bea-a7c7-b123f28223da admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:12.478151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de8850-2429-4bea-a7c7-b123f28223da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:12.479804 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de8850-2429-4bea-a7c7-b123f28223da admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:12.491577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1253/2478] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:12.495887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:12.507155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db0c72-7aba-4176-813f-6f322058ae99 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:12.512765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:12.513453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:12.513737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:12.514017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] PATH_INFO: `/v3/projects/9be8a4f766914e84bb09ee816f670152/users/06e2aeb2542f420e9cffea9ee9cca556/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:12.516033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be8a4f766914e84bb09ee816f670152, user_id=06e2aeb2542f420e9cffea9ee9cca556, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:12.518726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:12.530592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1226/2479] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:12 2022] PUT /identity/v3/projects/9be8a4f766914e84bb09ee816f670152/users/06e2aeb2542f420e9cffea9ee9cca556/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:12.542056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250ff2-b7b8-4433-93b7-2469733901c6 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:12.542347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250ff2-b7b8-4433-93b7-2469733901c6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:12.542630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d250ff2-b7b8-4433-93b7-2469733901c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:12.570532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-0d250ff2-b7b8-4433-93b7-2469733901c6 None None] MFA Rules not processed for user `06e2aeb2542f420e9cffea9ee9cca556`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:12.571764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0d250ff2-b7b8-4433-93b7-2469733901c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:12.641072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1254/2480] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:12 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:12.653261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:12.655417 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:12.719371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab415058-25e7-4277-b803-e9c5bb012158 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:12.723300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b8d3b-78c7-445d-b449-245c663be1ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:12.723916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8d3b-78c7-445d-b449-245c663be1ba service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:12.724223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8d3b-78c7-445d-b449-245c663be1ba service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:12.724513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8d3b-78c7-445d-b449-245c663be1ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:12.736271 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b8d3b-78c7-445d-b449-245c663be1ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:12.737756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b8d3b-78c7-445d-b449-245c663be1ba service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:12.749189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1227/2481] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:12 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:13.097856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250ff2-b7b8-4433-93b7-2469733901c6 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:13.108030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d250ff2-b7b8-4433-93b7-2469733901c6 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:13.111754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:13.112411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:13.112689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:13.112992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:13.128069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:13.182887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:13.184472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:13.194650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1255/2482] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:13 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:14.063113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:14.063593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:14.063692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:14.088254 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:14.090448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:14.160462 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1228/2483] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:56:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:14.173148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:14.174626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:14.247935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cf54e-7ea6-4c17-84d2-9260dd157e10 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:14.254003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:14.254003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:14.254208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:14.254731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:14.264561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:14.266439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:14.276253 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1256/2484] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:56:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:56:19.951801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:19.953309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:19.973603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:20.022722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9664cec-abd3-4517-a4a8-fe2c8503814b None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:20.026765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea6572-addc-4a33-bc22-2447fb84c1ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:20.027581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6572-addc-4a33-bc22-2447fb84c1ce service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:20.028029 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6572-addc-4a33-bc22-2447fb84c1ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:20.028508 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea6572-addc-4a33-bc22-2447fb84c1ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:20.031526 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-00ea6572-addc-4a33-bc22-2447fb84c1ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:20.205196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6572-addc-4a33-bc22-2447fb84c1ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:20.206594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea6572-addc-4a33-bc22-2447fb84c1ce service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:20.217189 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1229/2485] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:20.753154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:20.775220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9064eaa-9f30-4821-9b6a-bbf30f9ed1f9 service swift] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:20.781227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:20.782175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:20.782798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:20.783294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] PATH_INFO: `/v3/users/4719e87ae18848a5a85ff1ba5cfdce80` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:20.784864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4719e87ae18848a5a85ff1ba5cfdce80)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:20.787182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:21.004924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4719e87ae18848a5a85ff1ba5cfdce80'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:21.006228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4719e87ae18848a5a85ff1ba5cfdce80'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:21.007011 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4719e87ae18848a5a85ff1ba5cfdce80'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:21.035608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4719e87ae18848a5a85ff1ba5cfdce80'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:21.131500 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4719e87ae18848a5a85ff1ba5cfdce80'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:21.152756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1257/2486] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:20 2022] DELETE /identity/v3/users/4719e87ae18848a5a85ff1ba5cfdce80 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:21.157642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:21.158204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:21.158204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:21.200210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:21.201565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:21.297781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1230/2487] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:21.305113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:21.306954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:21.351496 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:21.467593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c482903-847f-4ef0-a286-8550b1911ae5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:21.474183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:21.475031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:21.475421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:21.475717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:21.489795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:21.511505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:21.512724 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1258/2488] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:22.385432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:22.390506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:22.420957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9e4b4-aa27-4934-af82-febc93c9a263 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:22.432935 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:22.433992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:22.434454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:22.435121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] PATH_INFO: `/v3/projects/8606a5b17f794726b6ec02198faca3a2` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:22.455913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8606a5b17f794726b6ec02198faca3a2)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:22.458449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:22.628003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8606a5b17f794726b6ec02198faca3a2', 'request_id': 'req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:22.634742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8606a5b17f794726b6ec02198faca3a2', 'request_id': 'req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:22.647641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8606a5b17f794726b6ec02198faca3a2', 'request_id': 'req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:22.649792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:22.751285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] The token cache is being invalidate because project 8606a5b17f794726b6ec02198faca3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:22.751285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:22.751646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:22.756172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1231/2489] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:22 2022] DELETE /identity/v3/projects/8606a5b17f794726b6ec02198faca3a2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:22.757320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:22.767472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25cea-4259-4617-8e50-e0ecaeada598 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:22.832826 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:22.833681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:22.834065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:22.834443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] PATH_INFO: `/v3/users/06e2aeb2542f420e9cffea9ee9cca556` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:22.835698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e2aeb2542f420e9cffea9ee9cca556)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:22.838259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:23.014254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e2aeb2542f420e9cffea9ee9cca556'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:23.014930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e2aeb2542f420e9cffea9ee9cca556'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:23.015673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e2aeb2542f420e9cffea9ee9cca556'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:23.033974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e2aeb2542f420e9cffea9ee9cca556'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:23.098420 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-14e42a68-63a8-402e-a501-db9569cc06a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e2aeb2542f420e9cffea9ee9cca556'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:23.115033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1259/2490] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:22 2022] DELETE /identity/v3/users/06e2aeb2542f420e9cffea9ee9cca556 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:23.896437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:23.896437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:23.913191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea6240-e203-4f7f-8e6b-9ae11f1afb7d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:24.000140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:24.001778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.002140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.002563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] PATH_INFO: `/v3/projects/9be8a4f766914e84bb09ee816f670152` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.005370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be8a4f766914e84bb09ee816f670152)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:24.008411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:24.180374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be8a4f766914e84bb09ee816f670152', 'request_id': 'req-2002d583-eb80-4990-9da8-17c94007ef6b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:24.186939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be8a4f766914e84bb09ee816f670152', 'request_id': 'req-2002d583-eb80-4990-9da8-17c94007ef6b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:24.211290 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be8a4f766914e84bb09ee816f670152', 'request_id': 'req-2002d583-eb80-4990-9da8-17c94007ef6b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:24.294008 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] The token cache is being invalidate because project 9be8a4f766914e84bb09ee816f670152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:24.294358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:24.295293 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2002d583-eb80-4990-9da8-17c94007ef6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:24.297165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1232/2491] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:23 2022] DELETE /identity/v3/projects/9be8a4f766914e84bb09ee816f670152 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:24.302993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb88d-d954-4fc0-a96c-5734671e27e0 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.305605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb88d-d954-4fc0-a96c-5734671e27e0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.306266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bb88d-d954-4fc0-a96c-5734671e27e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.354855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fb5bb88d-d954-4fc0-a96c-5734671e27e0 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:24.359894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fb5bb88d-d954-4fc0-a96c-5734671e27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:24.413188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:24.464098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bcd53-2f27-4ce0-9714-94227be4edf2 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.464098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bcd53-2f27-4ce0-9714-94227be4edf2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.464098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bcd53-2f27-4ce0-9714-94227be4edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.464677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1260/2492] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:24.501365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-927bcd53-2f27-4ce0-9714-94227be4edf2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:24.503147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-927bcd53-2f27-4ce0-9714-94227be4edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:24.530671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1233/2493] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:24.532246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bb88d-d954-4fc0-a96c-5734671e27e0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:24.545413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bb88d-d954-4fc0-a96c-5734671e27e0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:24.555552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:24.566889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.566889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.566889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.566889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:24.566889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:24.566889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:24.577710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1261/2494] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:56:24.582245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bcd53-2f27-4ce0-9714-94227be4edf2 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:24.601314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bcd53-2f27-4ce0-9714-94227be4edf2 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:24.601314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:24.601314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.601314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.601896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.601987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:24.604121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:24.712569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1234/2495] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:24 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:24.717807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:24.729670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc5541-e541-4596-8f55-52ddd67ed76b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:24.790741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:24.791352 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.791658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.791930 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.792589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:24.794507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:24.914418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1262/2496] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:24 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:24.917142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:24.929910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446fb6d-5d0b-46d5-8447-d7069baa8f47 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:24.935701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:24.936611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.937093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.937617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.938486 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:24.940433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:24.953774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1235/2497] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:24.957972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:24.969857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dcbd02-b019-4ba2-998f-68013f79431e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:24.974594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a931b-2917-4de0-9587-a4bed88d2b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:24.975219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a931b-2917-4de0-9587-a4bed88d2b8d admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:24.975495 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a931b-2917-4de0-9587-a4bed88d2b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:24.975769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a931b-2917-4de0-9587-a4bed88d2b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:24.976721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a931b-2917-4de0-9587-a4bed88d2b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:24.978213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a931b-2917-4de0-9587-a4bed88d2b8d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:24.989882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1263/2498] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:24.994003 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.005416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d549c-e893-4d6d-a167-ec796707e4e8 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.013019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.013758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.013974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.014251 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] PATH_INFO: `/v3/projects/f46fe7c0d94a43bb88ced42348012ee0/users/ad427c2815d04188871dd76ebd082c4d/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.033870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46fe7c0d94a43bb88ced42348012ee0, user_id=ad427c2815d04188871dd76ebd082c4d, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.036585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.116082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1236/2499] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:24 2022] PUT /identity/v3/projects/f46fe7c0d94a43bb88ced42348012ee0/users/ad427c2815d04188871dd76ebd082c4d/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:25.126617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.126860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.127139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.154244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] MFA Rules not processed for user `ad427c2815d04188871dd76ebd082c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:25.155447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:25.218970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1264/2500] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:25.223427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.232886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.234752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:25.247491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:25.278360 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:25.291301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9886a8-65a0-480f-86e8-cfbfa7020038 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.296741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.297354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.297719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.298007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.298652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.300623 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.306769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a01c7b-948b-4388-8da8-19a3359eb3a0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.312401 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.318812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.318812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.318812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] PATH_INFO: `/v3/users/d7d7577ea743410ca308f62b04e7cf58` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.318812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d7577ea743410ca308f62b04e7cf58)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.318812 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.405208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1237/2501] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:25 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:25.406392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.474099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7a6b-fa6e-4d72-b674-1f6cff2a5588 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.478848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.480646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.480958 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.481218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.481850 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.483786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.534866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d7577ea743410ca308f62b04e7cf58'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:25.535539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d7577ea743410ca308f62b04e7cf58'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:25.536161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d7577ea743410ca308f62b04e7cf58'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:25.548303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d7577ea743410ca308f62b04e7cf58'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:25.584388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1238/2502] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:25 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:25.588929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.590565 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:25.604816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f409f4-61d5-466c-b07a-952768fd39f4 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.609875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.610490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.610780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.611061 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.611903 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.613596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.625347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1239/2503] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:25.629406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.635714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d7577ea743410ca308f62b04e7cf58'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:25.639497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02b779-33d2-4568-becf-1f853b369cfe admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.645618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.645618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.646217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.646651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] PATH_INFO: `/v3/projects/0a07edef04484cfcb2266ece2a4c2458/users/3b556b9f3ebe457d855a4df13785aa43/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.651862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1265/2504] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:25 2022] DELETE /identity/v3/users/d7d7577ea743410ca308f62b04e7cf58 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:25.665562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a07edef04484cfcb2266ece2a4c2458, user_id=3b556b9f3ebe457d855a4df13785aa43, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.668942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.740967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1240/2505] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:25 2022] PUT /identity/v3/projects/0a07edef04484cfcb2266ece2a4c2458/users/3b556b9f3ebe457d855a4df13785aa43/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:25.744986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.828017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784c397-4cab-43e4-8c38-3ad170256887 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.884961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.886387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.886823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.887235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.888238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.889853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.895520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:25.896057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.897674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:25.909195 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1266/2506] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:25.910103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:25.913775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9001d-5d06-4d04-813f-76009ead6ce8 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.920560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.921469 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bde688-a9a3-41ee-a837-aa108baafe3e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:25.922728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.923194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.923638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] PATH_INFO: `/v3/projects/618a763b43164bcea96d5b735162d38f` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.926603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d6307-df9a-4ca9-a899-6c5d3e265379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:25.927273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d6307-df9a-4ca9-a899-6c5d3e265379 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.927915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d6307-df9a-4ca9-a899-6c5d3e265379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.927915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d6307-df9a-4ca9-a899-6c5d3e265379 admin admin] PATH_INFO: `/v3/projects/0a07edef04484cfcb2266ece2a4c2458/users/3b556b9f3ebe457d855a4df13785aa43/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.930033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d6307-df9a-4ca9-a899-6c5d3e265379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a07edef04484cfcb2266ece2a4c2458, user_id=3b556b9f3ebe457d855a4df13785aa43, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.932968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d6307-df9a-4ca9-a899-6c5d3e265379 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.936728 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618a763b43164bcea96d5b735162d38f)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:25.938680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:25.953428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1267/2507] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:25 2022] PUT /identity/v3/projects/0a07edef04484cfcb2266ece2a4c2458/users/3b556b9f3ebe457d855a4df13785aa43/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:25.965883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:25.969157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:25.969157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:25.998295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] MFA Rules not processed for user `3b556b9f3ebe457d855a4df13785aa43`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:25.999544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:26.062746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618a763b43164bcea96d5b735162d38f', 'request_id': 'req-11190d8e-2163-4d0b-9e25-8fb6292f57c5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:26.065357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:26.076426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618a763b43164bcea96d5b735162d38f', 'request_id': 'req-11190d8e-2163-4d0b-9e25-8fb6292f57c5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:26.082991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618a763b43164bcea96d5b735162d38f', 'request_id': 'req-11190d8e-2163-4d0b-9e25-8fb6292f57c5'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:26.097463 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1268/2508] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:26.111980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:26.113667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:26.158765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] The token cache is being invalidate because project 618a763b43164bcea96d5b735162d38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:26.158765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:26.160733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-11190d8e-2163-4d0b-9e25-8fb6292f57c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:26.166167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1241/2509] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:25 2022] DELETE /identity/v3/projects/618a763b43164bcea96d5b735162d38f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:26.167711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095074d0-f0d2-40c5-b11e-e06b97606d4f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.170158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095074d0-f0d2-40c5-b11e-e06b97606d4f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.170509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095074d0-f0d2-40c5-b11e-e06b97606d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.204471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea52d0-c0db-4480-aeb4-950925cbea35 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:26.211303 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-095074d0-f0d2-40c5-b11e-e06b97606d4f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:26.214482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-095074d0-f0d2-40c5-b11e-e06b97606d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:26.265033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:26.265669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.265952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.266257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.269163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:26.299899 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1242/2510] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:26.309653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca89ed-dc7b-46ad-a575-0bf195faf11a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.310005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca89ed-dc7b-46ad-a575-0bf195faf11a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.310242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca89ed-dc7b-46ad-a575-0bf195faf11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.335155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:26.336123 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9eca89ed-dc7b-46ad-a575-0bf195faf11a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:26.337430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9eca89ed-dc7b-46ad-a575-0bf195faf11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:26.346264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1243/2511] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:26.356246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca89ed-dc7b-46ad-a575-0bf195faf11a None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:26.360102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:26.364151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:26.367692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca89ed-dc7b-46ad-a575-0bf195faf11a None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:26.372760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:26.373384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.373666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.373944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.374601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:26.374915 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:26.376843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:26.381924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1269/2512] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:56:26.392324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1244/2513] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:56:26.399093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:26.410141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df60ae-3449-4abd-9174-ceaabe4fa613 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:26.415358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:26.416539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.421409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.421409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.421409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:26.421409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:26.506876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1270/2514] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:26 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:26.512414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:26.530663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ccd14-afe1-4627-87ea-4ad92c437c7b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:26.595243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:26.595870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.596342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.597240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.597240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:26.599266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:26.698024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1245/2515] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:26 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:26.699497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:26.711443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93efad-36fe-46de-ba00-7bff5c080864 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:26.717344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:26.717979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.718265 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.718533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.719206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:26.720926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:26.732373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1271/2516] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:26.736445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:26.747059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f4fb7-a461-4e47-878f-496a95156f95 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:26.752246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6db784-494c-42b4-b9ef-09608e1dd19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:26.752819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6db784-494c-42b4-b9ef-09608e1dd19a admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.753105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6db784-494c-42b4-b9ef-09608e1dd19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.753385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6db784-494c-42b4-b9ef-09608e1dd19a admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.754034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6db784-494c-42b4-b9ef-09608e1dd19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:26.755632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6db784-494c-42b4-b9ef-09608e1dd19a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:26.766208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1246/2517] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:26.770292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:26.780544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70307b7f-3de9-435c-9617-f1beab154e24 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:26.785320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:26.790356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.790356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.790356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] PATH_INFO: `/v3/projects/95e9f68dc02d43faad006f9ed6d9f3f6/users/f7a5f6b6fc934a788ac126812e31ab41/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.802399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e9f68dc02d43faad006f9ed6d9f3f6, user_id=f7a5f6b6fc934a788ac126812e31ab41, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:26.805296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:26.902782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1272/2518] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:26 2022] PUT /identity/v3/projects/95e9f68dc02d43faad006f9ed6d9f3f6/users/f7a5f6b6fc934a788ac126812e31ab41/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:26.913806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d833-fe72-4bc1-a47b-e98fec27cf7f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:26.913806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d833-fe72-4bc1-a47b-e98fec27cf7f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:26.913806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75d833-fe72-4bc1-a47b-e98fec27cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:26.943637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2c75d833-fe72-4bc1-a47b-e98fec27cf7f None None] MFA Rules not processed for user `f7a5f6b6fc934a788ac126812e31ab41`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:26.944904 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2c75d833-fe72-4bc1-a47b-e98fec27cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:26.983224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:27.023403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1247/2519] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:27.035433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:27.037295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:27.127696 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697dc94-e301-4f31-afe8-e23e40a6a092 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:27.137643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:27.137643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:27.137643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:27.137643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:27.142664 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:27.144324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:27.153916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1273/2520] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:30.252873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:30.253335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:30.253562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:30.272912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:30.274190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:30.338961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1248/2521] 10.222.0.27 () {58 vars in 967 bytes} [Mon Aug 22 05:56:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:30.351348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:30.352821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:30.423223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad4e4-3d0b-438f-a7aa-a8eaa20c28b0 service nova] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:30.429425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f785-4089-4439-80a8-39af52771134 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:30.430100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f785-4089-4439-80a8-39af52771134 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:30.430915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f785-4089-4439-80a8-39af52771134 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:30.430915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368f785-4089-4439-80a8-39af52771134 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:30.439353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368f785-4089-4439-80a8-39af52771134 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:30.441045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368f785-4089-4439-80a8-39af52771134 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:30.446475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:30.450955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1274/2522] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:56:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:56:30.525056 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:30.527292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:30.628853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13bc40-dd5c-4a4b-87e0-6284caa300da None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:30.639114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:30.639868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:30.640308 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:30.640749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] PATH_INFO: `/v3/users/ad427c2815d04188871dd76ebd082c4d` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:30.642841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad427c2815d04188871dd76ebd082c4d)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:30.645764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:30.658154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f785-4089-4439-80a8-39af52771134 service swift] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:30.663502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9368f785-4089-4439-80a8-39af52771134 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:30.720895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368f785-4089-4439-80a8-39af52771134 service swift] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:30.724613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641aba3-b3ca-47f2-b68a-a4545286f704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:30.725220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641aba3-b3ca-47f2-b68a-a4545286f704 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:30.725549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641aba3-b3ca-47f2-b68a-a4545286f704 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:30.725769 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641aba3-b3ca-47f2-b68a-a4545286f704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:30.733868 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6641aba3-b3ca-47f2-b68a-a4545286f704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:30.806049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641aba3-b3ca-47f2-b68a-a4545286f704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:30.808017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641aba3-b3ca-47f2-b68a-a4545286f704 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:30.817632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1275/2523] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:56:30.896005 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad427c2815d04188871dd76ebd082c4d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:30.896689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad427c2815d04188871dd76ebd082c4d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:30.897358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad427c2815d04188871dd76ebd082c4d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:30.904265 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad427c2815d04188871dd76ebd082c4d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:30.979020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad427c2815d04188871dd76ebd082c4d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:30.997428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:31.004730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1249/2524] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:30 2022] DELETE /identity/v3/users/ad427c2815d04188871dd76ebd082c4d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:31.016098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:31.016421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:31.016703 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:31.036271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:31.037589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:31.111800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1276/2525] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:31.123889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:31.126015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:31.183710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91731118-b592-45ad-bcd6-bfd02d0ffb70 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:31.187207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:31.187803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:31.188085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:31.188390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:31.197125 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:31.198585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:31.207720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1250/2526] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:31.696798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:31.698421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:31.715091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aaa69-5593-4bf9-8c3f-cb2aae65d43a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:31.732960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:31.733772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:31.734023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:31.734270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] PATH_INFO: `/v3/projects/f46fe7c0d94a43bb88ced42348012ee0` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:31.736136 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46fe7c0d94a43bb88ced42348012ee0)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:31.738148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:31.851288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:31.855524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46fe7c0d94a43bb88ced42348012ee0', 'request_id': 'req-727f0ed6-34c0-4458-866b-a8fc8d025347'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:31.862416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46fe7c0d94a43bb88ced42348012ee0', 'request_id': 'req-727f0ed6-34c0-4458-866b-a8fc8d025347'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:31.939805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46fe7c0d94a43bb88ced42348012ee0', 'request_id': 'req-727f0ed6-34c0-4458-866b-a8fc8d025347'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:31.952297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] The token cache is being invalidate because project f46fe7c0d94a43bb88ced42348012ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:31.952632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:31.953356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:31.955156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1277/2527] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:31 2022] DELETE /identity/v3/projects/f46fe7c0d94a43bb88ced42348012ee0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:31.958978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:31.969953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad14b8-ec65-4054-b37a-4b5439318db6 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:32.038682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:32.039349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:32.039614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:32.039889 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] PATH_INFO: `/v3/users/3b556b9f3ebe457d855a4df13785aa43` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:32.041075 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b556b9f3ebe457d855a4df13785aa43)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:32.043168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:32.171947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b556b9f3ebe457d855a4df13785aa43'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.172703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b556b9f3ebe457d855a4df13785aa43'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.173313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b556b9f3ebe457d855a4df13785aa43'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.183739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b556b9f3ebe457d855a4df13785aa43'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.246724 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-73372fce-d999-4b36-a5f2-9cd74b35d757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b556b9f3ebe457d855a4df13785aa43'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.269531 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1251/2528] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:31 2022] DELETE /identity/v3/users/3b556b9f3ebe457d855a4df13785aa43 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:32.677010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:32.679301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:32.692982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f0ed6-34c0-4458-866b-a8fc8d025347 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:32.750038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:32.750676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:32.750926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:32.751197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] PATH_INFO: `/v3/projects/0a07edef04484cfcb2266ece2a4c2458` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:32.752333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a07edef04484cfcb2266ece2a4c2458)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:32.754341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:32.858819 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a07edef04484cfcb2266ece2a4c2458', 'request_id': 'req-2601ece0-90d5-458c-9780-380e2ca5f6c2'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.865036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a07edef04484cfcb2266ece2a4c2458', 'request_id': 'req-2601ece0-90d5-458c-9780-380e2ca5f6c2'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.904386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a07edef04484cfcb2266ece2a4c2458', 'request_id': 'req-2601ece0-90d5-458c-9780-380e2ca5f6c2'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.920706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] The token cache is being invalidate because project 0a07edef04484cfcb2266ece2a4c2458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:32.921097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.921825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2601ece0-90d5-458c-9780-380e2ca5f6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:32.923705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1278/2529] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:32 2022] DELETE /identity/v3/projects/0a07edef04484cfcb2266ece2a4c2458 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:32.928897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee7499-4442-48e8-b7ef-a37a59499d25 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:32.929190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee7499-4442-48e8-b7ef-a37a59499d25 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:32.929509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee7499-4442-48e8-b7ef-a37a59499d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:32.949701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f4ee7499-4442-48e8-b7ef-a37a59499d25 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:32.950933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f4ee7499-4442-48e8-b7ef-a37a59499d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:32.960767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:33.018556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1252/2530] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:33.021722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3bb27-ddb6-4532-956e-0c1c37180719 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.022013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3bb27-ddb6-4532-956e-0c1c37180719 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.022298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b3bb27-ddb6-4532-956e-0c1c37180719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.042694 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f6b3bb27-ddb6-4532-956e-0c1c37180719 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:33.043958 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f6b3bb27-ddb6-4532-956e-0c1c37180719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:33.051944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1279/2531] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:33.056261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee7499-4442-48e8-b7ef-a37a59499d25 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.066188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee7499-4442-48e8-b7ef-a37a59499d25 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.071464 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.072069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.072381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.072779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.073449 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:33.073760 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.075407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:33.093527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1253/2532] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:56:33.094853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3bb27-ddb6-4532-956e-0c1c37180719 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.104939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b3bb27-ddb6-4532-956e-0c1c37180719 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.109813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.110420 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.110701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.110977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.111610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.113547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:33.226476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1280/2533] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:33 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:33.231340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.241597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d081393-4825-4623-ae6d-37afda743c50 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.299397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.300041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.300353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.300630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.301264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.309026 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:33.396223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1254/2534] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:33 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:33.409046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.419462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76647b-0bcc-4beb-8e3f-95d3cac7e4ce admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.424326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.424936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.425218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.425504 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.426221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.427865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:33.438556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1281/2535] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:33.442599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.453578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf766-be4f-4ae0-9829-70c38e18c955 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.459513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf9635-c1e7-4dc3-bcd9-fc3f19ed6815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.460225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9635-c1e7-4dc3-bcd9-fc3f19ed6815 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.460552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9635-c1e7-4dc3-bcd9-fc3f19ed6815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.460864 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf9635-c1e7-4dc3-bcd9-fc3f19ed6815 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.464164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf9635-c1e7-4dc3-bcd9-fc3f19ed6815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.464164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf9635-c1e7-4dc3-bcd9-fc3f19ed6815 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:33.475513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1255/2536] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:33.479932 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.490248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122324-cc49-439d-82aa-07ce4a3a3c9b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.495344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.496019 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.496324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.498091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] PATH_INFO: `/v3/projects/9432d17be05644bbb6edb4e6ce11adad/users/800da24dd8b542918415db1d7d6ee347/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.551901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9432d17be05644bbb6edb4e6ce11adad, user_id=800da24dd8b542918415db1d7d6ee347, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.554619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:33.623984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:33.629911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1282/2537] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:33 2022] PUT /identity/v3/projects/9432d17be05644bbb6edb4e6ce11adad/users/800da24dd8b542918415db1d7d6ee347/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:33.641182 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b14d-8d67-4e4c-9ee5-362617b7805e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.641468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b14d-8d67-4e4c-9ee5-362617b7805e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.641744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641b14d-8d67-4e4c-9ee5-362617b7805e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.670113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f641b14d-8d67-4e4c-9ee5-362617b7805e None None] MFA Rules not processed for user `800da24dd8b542918415db1d7d6ee347`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:33.671645 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f641b14d-8d67-4e4c-9ee5-362617b7805e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:33.739207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1256/2538] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:33.743598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.805676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575c0767-e4a8-448c-9da8-5f27b5a2b18f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.811111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.811795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.812081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.812389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.813030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.814986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:33.915233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1283/2539] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:33 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:33.916548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641b14d-8d67-4e4c-9ee5-362617b7805e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:33.929606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641b14d-8d67-4e4c-9ee5-362617b7805e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:33.939504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:33.989770 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:33.990394 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:33.990655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:33.993629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:33.993629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:33.993629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.081883 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1257/2540] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:33 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:34.085786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.096284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef4546-2a35-4ce4-88b0-8107b620b165 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.103365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.104028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.104364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.104649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.106191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.107248 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.118156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1284/2541] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:34.122735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.132683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568e3b8-b9cf-43f5-815c-46d8fd05137a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.138049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c9234-e658-4489-ae3c-1461f572c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.142763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9234-e658-4489-ae3c-1461f572c86c admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.142763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9234-e658-4489-ae3c-1461f572c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.142763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9234-e658-4489-ae3c-1461f572c86c admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.142763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c9234-e658-4489-ae3c-1461f572c86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.142763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c9234-e658-4489-ae3c-1461f572c86c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.151426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1258/2542] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:34.155656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.165798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4773a9-a07f-4cf8-bdeb-5e29495c409d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.170979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.171774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.172055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.172363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] PATH_INFO: `/v3/projects/57c33af37ec040f9ae832f3ee1ce4a27/users/d8370354a55d4eb7ad58618a47265b2b/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.187925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c33af37ec040f9ae832f3ee1ce4a27, user_id=d8370354a55d4eb7ad58618a47265b2b, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.190707 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.257374 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1285/2543] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:34 2022] PUT /identity/v3/projects/57c33af37ec040f9ae832f3ee1ce4a27/users/d8370354a55d4eb7ad58618a47265b2b/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:34.268414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.268860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.269248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.301814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] MFA Rules not processed for user `d8370354a55d4eb7ad58618a47265b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:34.303086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:34.366080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1259/2544] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:34.371230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.454531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3360d37-4509-48f1-8a7a-cdcdd84a2b51 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.460799 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.461692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.462034 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.462326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.462965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.465296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.538309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.538309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:34.552262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1286/2545] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:34 2022] POST /identity/v3/projects => generated 377 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:34.556648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95778ccc-5362-45eb-b9ec-e9526202521e None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.559170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.595811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:34.611820 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.612537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.612829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.613164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] PATH_INFO: `/v3/users/f7a5f6b6fc934a788ac126812e31ab41` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.614349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a5f6b6fc934a788ac126812e31ab41)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.616313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.625234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191769-f68e-4b39-8bd8-fd03ca255d83 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.630090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.630716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.631003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.631285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.631917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.633878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.638361 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:34.750364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1287/2546] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:34 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:34.754392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.763817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc88bb-e573-4aa8-b565-ecd8a4a50396 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.768557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.769132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.769411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.769684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.770316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.771947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.782145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1288/2547] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:34.785985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.795727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82423617-2960-4ce1-b3fd-15f304e13c12 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:34.800689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:34.801308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.801597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.801881 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] PATH_INFO: `/v3/projects/fcda2737067644c2a4427fe869eff800/users/a8d87c34da6e4a48ae828857cd1b47d6/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.814941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a5f6b6fc934a788ac126812e31ab41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:34.815615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a5f6b6fc934a788ac126812e31ab41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:34.816261 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a5f6b6fc934a788ac126812e31ab41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:34.816784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcda2737067644c2a4427fe869eff800, user_id=a8d87c34da6e4a48ae828857cd1b47d6, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:34.819544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:34.823243 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a5f6b6fc934a788ac126812e31ab41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:34.899388 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1289/2548] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:34 2022] PUT /identity/v3/projects/fcda2737067644c2a4427fe869eff800/users/a8d87c34da6e4a48ae828857cd1b47d6/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:34.904054 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:34.905701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:34.922757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2d6e970e-d6fc-4ff7-adf9-902b22bd6158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a5f6b6fc934a788ac126812e31ab41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:34.943548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1260/2549] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:34 2022] DELETE /identity/v3/users/f7a5f6b6fc934a788ac126812e31ab41 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:34.948320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:34.948617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:34.949162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:34.969287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:34.970482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:34.972152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c545916-e029-418c-bbac-22b4d8a525ff admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:35.029919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:35.030586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:35.030882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:35.031152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:35.031823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:35.033601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:35.044968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1290/2550] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:35.049197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:35.059879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891306c3-5fab-4342-a59c-47ebe3c481bc admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:35.064880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae551aa-7554-4acf-897b-fa67e3deb83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:35.065574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae551aa-7554-4acf-897b-fa67e3deb83e admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:35.065860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae551aa-7554-4acf-897b-fa67e3deb83e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:35.066152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae551aa-7554-4acf-897b-fa67e3deb83e admin admin] PATH_INFO: `/v3/projects/fcda2737067644c2a4427fe869eff800/users/a8d87c34da6e4a48ae828857cd1b47d6/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:35.068178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae551aa-7554-4acf-897b-fa67e3deb83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcda2737067644c2a4427fe869eff800, user_id=a8d87c34da6e4a48ae828857cd1b47d6, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:35.070901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae551aa-7554-4acf-897b-fa67e3deb83e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:35.083197 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1291/2551] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:35 2022] PUT /identity/v3/projects/fcda2737067644c2a4427fe869eff800/users/a8d87c34da6e4a48ae828857cd1b47d6/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:35.094673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:35.094969 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:35.095250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:35.124441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] MFA Rules not processed for user `a8d87c34da6e4a48ae828857cd1b47d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:35.125677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:35.130954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:35.152176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1261/2552] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:35.162032 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:35.163444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:35.198749 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1292/2553] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:35.210537 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:35.211953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:35.222516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5717e13-1a10-4a22-a07e-93d716bddfb4 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:35.267914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d95c85-0567-44ac-8e1d-eca6b558e016 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:35.271518 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:35.272125 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:35.272434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:35.272706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:35.273418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828d1c-0a37-411c-8b76-5f14fcf3adb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:35.274009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828d1c-0a37-411c-8b76-5f14fcf3adb5 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:35.274292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828d1c-0a37-411c-8b76-5f14fcf3adb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:35.274507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:35.274649 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828d1c-0a37-411c-8b76-5f14fcf3adb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:35.282823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:35.333021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:35.334467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:35.343195 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828d1c-0a37-411c-8b76-5f14fcf3adb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:35.343478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1293/2554] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:56:35.344698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828d1c-0a37-411c-8b76-5f14fcf3adb5 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:35.355110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1262/2555] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:56:35.757322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:35.762675 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:35.775626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98da89-a833-4b90-a661-eb98cfd7eded service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:35.781418 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:35.782398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:35.782697 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:35.782979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] PATH_INFO: `/v3/projects/95e9f68dc02d43faad006f9ed6d9f3f6` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:35.784159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e9f68dc02d43faad006f9ed6d9f3f6)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:35.786148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:35.893181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e9f68dc02d43faad006f9ed6d9f3f6', 'request_id': 'req-a16ce394-23af-4998-9de9-19f3cea2bfd1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:35.895066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:35.899510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e9f68dc02d43faad006f9ed6d9f3f6', 'request_id': 'req-a16ce394-23af-4998-9de9-19f3cea2bfd1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:36.007802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e9f68dc02d43faad006f9ed6d9f3f6', 'request_id': 'req-a16ce394-23af-4998-9de9-19f3cea2bfd1'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:36.023908 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] The token cache is being invalidate because project 95e9f68dc02d43faad006f9ed6d9f3f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:36.024294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:36.025090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-a16ce394-23af-4998-9de9-19f3cea2bfd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:36.027610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1294/2556] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:35 2022] DELETE /identity/v3/projects/95e9f68dc02d43faad006f9ed6d9f3f6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:36.033781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41dced-5274-48d2-9fc6-303980685744 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.034070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41dced-5274-48d2-9fc6-303980685744 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.034414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41dced-5274-48d2-9fc6-303980685744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.060767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-9e41dced-5274-48d2-9fc6-303980685744 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:36.061977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9e41dced-5274-48d2-9fc6-303980685744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:36.129439 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1263/2557] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:36.137449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec572e-cfc3-4c04-9cb2-5d6b62554972 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.137738 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec572e-cfc3-4c04-9cb2-5d6b62554972 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.138121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec572e-cfc3-4c04-9cb2-5d6b62554972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.159345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-89ec572e-cfc3-4c04-9cb2-5d6b62554972 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:36.160600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-89ec572e-cfc3-4c04-9cb2-5d6b62554972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:36.169848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1295/2558] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:36.177288 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41dced-5274-48d2-9fc6-303980685744 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.187094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41dced-5274-48d2-9fc6-303980685744 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:36.191832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:36.192472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.192758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.193041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.197676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:36.197676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:36.197676 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:36.207183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1264/2559] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:56:36.211459 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec572e-cfc3-4c04-9cb2-5d6b62554972 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.221286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec572e-cfc3-4c04-9cb2-5d6b62554972 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:36.233207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:36.233811 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.234095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.234408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.235047 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:36.236978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:36.333275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1296/2560] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:36 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:36.337437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.347712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aba97e-1fa0-4761-a7b2-8348f2f40291 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:36.405014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:36.405621 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.405963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.406247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.406876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:36.408829 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:36.487687 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1265/2561] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:36 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:36.491855 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.502224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa5661-574e-4759-994a-d2bf53724adc admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:36.506954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:36.507549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.511626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.511626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.511626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:36.511626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:36.523453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1297/2562] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:36.525517 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.535852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3fdaa-820e-416b-af4a-00a25295c4a5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:36.540585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce0a3c-a130-44f9-b5a1-acdc14485581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:36.541174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce0a3c-a130-44f9-b5a1-acdc14485581 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.541457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce0a3c-a130-44f9-b5a1-acdc14485581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.541734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce0a3c-a130-44f9-b5a1-acdc14485581 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.542375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce0a3c-a130-44f9-b5a1-acdc14485581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:36.543960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce0a3c-a130-44f9-b5a1-acdc14485581 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:36.554012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1266/2563] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:36.558285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.568151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f443c-1d72-454e-bae6-33b27c5cb5e5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:36.573448 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:36.574095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.574375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.574648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] PATH_INFO: `/v3/projects/10d008dbe16745f48f53459c2eccbc8c/users/1627b20ac9dc4438b9cb45c5f86cd1bb/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.595893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d008dbe16745f48f53459c2eccbc8c, user_id=1627b20ac9dc4438b9cb45c5f86cd1bb, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:36.595893 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:36.675859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1298/2564] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:36 2022] PUT /identity/v3/projects/10d008dbe16745f48f53459c2eccbc8c/users/1627b20ac9dc4438b9cb45c5f86cd1bb/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:36.687255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097646ed-7a78-41d3-a147-5202a526f940 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.687549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097646ed-7a78-41d3-a147-5202a526f940 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.687833 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097646ed-7a78-41d3-a147-5202a526f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.708115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:36.716692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-097646ed-7a78-41d3-a147-5202a526f940 None None] MFA Rules not processed for user `1627b20ac9dc4438b9cb45c5f86cd1bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:36.717942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-097646ed-7a78-41d3-a147-5202a526f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:36.780257 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1267/2565] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:36.784715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.846778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d19efb-0ee6-4b97-86b2-2ca309cbdb87 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:36.851366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:36.851960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:36.852268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:36.852546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:36.853175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:36.855069 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:36.950578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1299/2566] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:36 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:36.954690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097646ed-7a78-41d3-a147-5202a526f940 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:36.965572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097646ed-7a78-41d3-a147-5202a526f940 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.021764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.022385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.022675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.022954 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.023585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.025534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.132942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1268/2567] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:36 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:37.137781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:37.150651 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f2d9a-9942-416e-b5f1-f4afc632de99 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.155965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.156621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.156901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.161356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.161356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.161356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.179666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1300/2568] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:37.181191 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:37.195931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadd6bc-3678-446d-a65c-569e69d7ac12 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.198536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.199560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.200066 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.201630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] PATH_INFO: `/v3/projects/dae0c17df02b4e3ba6a10169f0c05bc8/users/258a05ff946241f796851476c911714f/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.218816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae0c17df02b4e3ba6a10169f0c05bc8, user_id=258a05ff946241f796851476c911714f, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.221718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.276643 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:37.278808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:37.279471 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1269/2569] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:37 2022] PUT /identity/v3/projects/dae0c17df02b4e3ba6a10169f0c05bc8/users/258a05ff946241f796851476c911714f/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:37.283422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:37.356640 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b754ad-4dc5-4722-970e-aca78ab5be60 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.360383 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:37.370264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405292-f045-4cb8-9d1f-3d1d885bc78e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.374957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.375564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.375854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.376124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.376854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.378489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.389537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1270/2570] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:56:37.393912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:37.401160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:37.405700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef77a3-cc16-4457-a72c-2c8ec7a747fb admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.409410 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.410060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.410408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.410692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.410813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de38ea0-56df-4074-9ac2-87a14537e379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.411426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de38ea0-56df-4074-9ac2-87a14537e379 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.411707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de38ea0-56df-4074-9ac2-87a14537e379 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.411982 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de38ea0-56df-4074-9ac2-87a14537e379 admin admin] PATH_INFO: `/v3/projects/dae0c17df02b4e3ba6a10169f0c05bc8/users/258a05ff946241f796851476c911714f/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.412478 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:37.414409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de38ea0-56df-4074-9ac2-87a14537e379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae0c17df02b4e3ba6a10169f0c05bc8, user_id=258a05ff946241f796851476c911714f, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.417655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de38ea0-56df-4074-9ac2-87a14537e379 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.428135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1271/2571] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:37 2022] PUT /identity/v3/projects/dae0c17df02b4e3ba6a10169f0c05bc8/users/258a05ff946241f796851476c911714f/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:37.439365 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994f38f-e4c2-49c4-81d2-27ebd7103826 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.439653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994f38f-e4c2-49c4-81d2-27ebd7103826 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.439932 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994f38f-e4c2-49c4-81d2-27ebd7103826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.466991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c994f38f-e4c2-49c4-81d2-27ebd7103826 None None] MFA Rules not processed for user `258a05ff946241f796851476c911714f`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:37.468224 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c994f38f-e4c2-49c4-81d2-27ebd7103826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:37.476762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.478244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.488087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1301/2572] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:37.546177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1272/2573] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:56:37.554942 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:37.556539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:37.568123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304e969-ddc3-4961-a85f-2d623fdd8ff9 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.618188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.618746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.619034 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.619317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.628623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.630072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.639599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1302/2574] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:37.849313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994f38f-e4c2-49c4-81d2-27ebd7103826 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:37.859835 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994f38f-e4c2-49c4-81d2-27ebd7103826 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:37.863461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:37.866599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:37.866599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:37.866599 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:37.922287 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:37.923718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:37.932827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1273/2575] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:38.988502 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:38.997665 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70edbdd-a44f-439c-a8c6-d398c0460087 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:39.001331 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590cb66-550e-4935-9bc5-a01c8df5336e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:39.006995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590cb66-550e-4935-9bc5-a01c8df5336e service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:39.006995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590cb66-550e-4935-9bc5-a01c8df5336e service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:39.006995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590cb66-550e-4935-9bc5-a01c8df5336e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:39.006995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2590cb66-550e-4935-9bc5-a01c8df5336e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:39.066407 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590cb66-550e-4935-9bc5-a01c8df5336e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:39.067765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590cb66-550e-4935-9bc5-a01c8df5336e service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:39.071685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:39.078294 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1303/2576] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:43.976017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:43.977442 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:44.049530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2b28c-7e11-431e-8b54-139132f929e6 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:44.054256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:44.054895 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:44.055177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:44.055453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] PATH_INFO: `/v3/users/800da24dd8b542918415db1d7d6ee347` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:44.056613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800da24dd8b542918415db1d7d6ee347)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:44.059105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:44.072592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:44.243238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800da24dd8b542918415db1d7d6ee347'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:44.243797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800da24dd8b542918415db1d7d6ee347'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:44.244425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800da24dd8b542918415db1d7d6ee347'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:44.251797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800da24dd8b542918415db1d7d6ee347'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:44.344748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800da24dd8b542918415db1d7d6ee347'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:44.362925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1274/2577] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:43 2022] DELETE /identity/v3/users/800da24dd8b542918415db1d7d6ee347 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:44.367449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:44.367911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:44.368031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:44.386756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:44.387950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:44.445414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1304/2578] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:44.454685 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:44.456082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:44.513441 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bdf0b-d33e-4f26-8e4b-234d0203bbe1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:44.517181 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:44.517789 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:44.518099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:44.518380 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:44.528069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:44.529554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:44.539002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1275/2579] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:44.968379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:44.969838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:44.983296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb59e-97f1-4bd0-a662-859642356cf6 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:44.989656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:44.989656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:44.989656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:44.989656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] PATH_INFO: `/v3/projects/9432d17be05644bbb6edb4e6ce11adad` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:44.990791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9432d17be05644bbb6edb4e6ce11adad)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:44.992830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:45.113275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9432d17be05644bbb6edb4e6ce11adad', 'request_id': 'req-702a0f99-d23d-444f-a70c-dbb1d71d8b84'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.120079 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9432d17be05644bbb6edb4e6ce11adad', 'request_id': 'req-702a0f99-d23d-444f-a70c-dbb1d71d8b84'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.212861 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9432d17be05644bbb6edb4e6ce11adad', 'request_id': 'req-702a0f99-d23d-444f-a70c-dbb1d71d8b84'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.224825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] The token cache is being invalidate because project 9432d17be05644bbb6edb4e6ce11adad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:45.225049 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.225700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.227224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1305/2580] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:44 2022] DELETE /identity/v3/projects/9432d17be05644bbb6edb4e6ce11adad => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:56:45.231252 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:45.241755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e36bb8-c864-4d17-90a5-b6287a203377 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:45.312305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:45.312942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:45.313329 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:45.313590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] PATH_INFO: `/v3/users/d8370354a55d4eb7ad58618a47265b2b` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:45.314812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8370354a55d4eb7ad58618a47265b2b)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:45.316827 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:45.491860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:45.500613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8370354a55d4eb7ad58618a47265b2b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.501267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8370354a55d4eb7ad58618a47265b2b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.501947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8370354a55d4eb7ad58618a47265b2b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.508795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8370354a55d4eb7ad58618a47265b2b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.651678 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8370354a55d4eb7ad58618a47265b2b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:45.669534 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1276/2581] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:45 2022] DELETE /identity/v3/users/d8370354a55d4eb7ad58618a47265b2b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:46.021283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:46.022791 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:46.037967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a0f99-d23d-444f-a70c-dbb1d71d8b84 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:46.097061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:46.097977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:46.098342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:46.098695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] PATH_INFO: `/v3/projects/57c33af37ec040f9ae832f3ee1ce4a27` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:46.100063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c33af37ec040f9ae832f3ee1ce4a27)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:46.102105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:46.130295 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:46.264657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c33af37ec040f9ae832f3ee1ce4a27', 'request_id': 'req-b6c45633-510c-4188-bdb7-d704457ffd7a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.271051 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c33af37ec040f9ae832f3ee1ce4a27', 'request_id': 'req-b6c45633-510c-4188-bdb7-d704457ffd7a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.337250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c33af37ec040f9ae832f3ee1ce4a27', 'request_id': 'req-b6c45633-510c-4188-bdb7-d704457ffd7a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.349370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] The token cache is being invalidate because project 57c33af37ec040f9ae832f3ee1ce4a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:46.349588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.350254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.351764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1306/2582] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:46 2022] DELETE /identity/v3/projects/57c33af37ec040f9ae832f3ee1ce4a27 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:46.355698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:46.357196 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:46.370340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8261d-937b-4ce3-bf8a-f0060df6aa5a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:46.426947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:46.427633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:46.427913 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:46.428186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] PATH_INFO: `/v3/users/a8d87c34da6e4a48ae828857cd1b47d6` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:46.429339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d87c34da6e4a48ae828857cd1b47d6)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:46.431262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:46.617460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d87c34da6e4a48ae828857cd1b47d6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.618161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d87c34da6e4a48ae828857cd1b47d6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.618795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d87c34da6e4a48ae828857cd1b47d6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.627477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d87c34da6e4a48ae828857cd1b47d6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.681998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-eb8bab29-b721-411c-87c1-85e9e3fa74cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d87c34da6e4a48ae828857cd1b47d6'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:46.701632 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1277/2583] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:46 2022] DELETE /identity/v3/users/a8d87c34da6e4a48ae828857cd1b47d6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:47.124362 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:47.125883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:47.139150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45633-510c-4188-bdb7-d704457ffd7a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:47.200021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:47.200713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.201001 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.201340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] PATH_INFO: `/v3/projects/fcda2737067644c2a4427fe869eff800` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.202471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcda2737067644c2a4427fe869eff800)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:47.204507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:47.315621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcda2737067644c2a4427fe869eff800', 'request_id': 'req-2ed77a73-61f1-46f6-9065-dce8c36fa007'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:47.321754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcda2737067644c2a4427fe869eff800', 'request_id': 'req-2ed77a73-61f1-46f6-9065-dce8c36fa007'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:47.402281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcda2737067644c2a4427fe869eff800', 'request_id': 'req-2ed77a73-61f1-46f6-9065-dce8c36fa007'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:47.413516 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] The token cache is being invalidate because project fcda2737067644c2a4427fe869eff800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:47.413808 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:47.414576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2ed77a73-61f1-46f6-9065-dce8c36fa007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:47.416108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1307/2584] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:47 2022] DELETE /identity/v3/projects/fcda2737067644c2a4427fe869eff800 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:47.421510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153582-1131-44a4-8869-53e0d5e80ee5 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.421995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153582-1131-44a4-8869-53e0d5e80ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.422110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153582-1131-44a4-8869-53e0d5e80ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.443135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-59153582-1131-44a4-8869-53e0d5e80ee5 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:47.444368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-59153582-1131-44a4-8869-53e0d5e80ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:47.473133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:47.502742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1278/2585] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:47.511422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c034-0c9c-408c-a7cd-46ff2814517a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.511708 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c034-0c9c-408c-a7cd-46ff2814517a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.511982 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090c034-0c9c-408c-a7cd-46ff2814517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.531603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e090c034-0c9c-408c-a7cd-46ff2814517a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:47.532869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e090c034-0c9c-408c-a7cd-46ff2814517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:47.540626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1308/2586] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:47.545415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153582-1131-44a4-8869-53e0d5e80ee5 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:47.554870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153582-1131-44a4-8869-53e0d5e80ee5 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:47.559434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:47.560052 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.560457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.560737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.561387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:47.561696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:47.563279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:47.575346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1279/2587] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:56:47.579571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c034-0c9c-408c-a7cd-46ff2814517a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:47.589695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090c034-0c9c-408c-a7cd-46ff2814517a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:47.594397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:47.595162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.595445 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.595723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.596405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:47.598335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:47.700787 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1309/2588] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:47 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:56:47.704916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:47.715768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf129cf-0176-4047-9100-cb3a6d831e99 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:47.769183 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:47.769777 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.770063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.770338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.770960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:47.772944 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:47.868663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1280/2589] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:47 2022] POST /identity/v3/users => generated 284 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:47.872921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:47.883104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48642a8a-04d1-458d-a8de-b68f934b4579 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:47.888350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:47.888948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.889232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.889506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.890176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:47.891818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:47.902217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1310/2590] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:47.906021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:47.915836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf556040-1a37-474f-a3a4-656f714cff3a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:47.920461 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29ba8c-c747-45ad-84c5-f687f7c3975a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:47.921050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29ba8c-c747-45ad-84c5-f687f7c3975a admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.921334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29ba8c-c747-45ad-84c5-f687f7c3975a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.921609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29ba8c-c747-45ad-84c5-f687f7c3975a admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.922248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29ba8c-c747-45ad-84c5-f687f7c3975a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:47.923916 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29ba8c-c747-45ad-84c5-f687f7c3975a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:47.934236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1281/2591] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:47.938159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:47.943278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:47.948900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dde6e8-505a-4609-9550-d03ecec1301f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:47.958222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:47.958222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:47.958222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:47.958222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] PATH_INFO: `/v3/projects/995546839897470398dfa724ca479ffd/users/85080fec05514185ab7164156b0df6d6/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:47.970731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995546839897470398dfa724ca479ffd, user_id=85080fec05514185ab7164156b0df6d6, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:47.973951 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:48.041181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1311/2592] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:47 2022] PUT /identity/v3/projects/995546839897470398dfa724ca479ffd/users/85080fec05514185ab7164156b0df6d6/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:48.051393 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:48.051691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:48.051970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:48.080856 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] MFA Rules not processed for user `85080fec05514185ab7164156b0df6d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:48.082057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:48.161325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1282/2593] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:48.168382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:48.170326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:48.235220 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665eeeb-61f1-427f-a00c-88b64762b068 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:48.238894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:48.239520 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:48.239804 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:48.240088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:48.249354 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:48.250775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:48.259350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1312/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:54.220783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:54.221884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:54.259115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:54.299976 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89b907-d60f-49fc-ba87-12105456caf8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:54.305238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:54.305908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:54.306193 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:54.306499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:54.308283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:54.320311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:54.321888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:54.336035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1283/2595] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:54.898137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:54.909372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ad771-4e20-4a4c-a0cf-83909258fc4c service glance] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:54.916002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:54.916645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:54.917157 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:54.917442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:54.919363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:54.931564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:54.933423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:54.944565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1313/2596] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:56:55.025080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:55.026602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:55.095505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75056016-8e4c-4c06-952e-3df72c25f0e1 service placement] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:55.100017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:55.100674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:55.100956 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:55.101229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] PATH_INFO: `/v3/users/ab9abbb0208e4662afaaff2e1344deff` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:55.102342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9abbb0208e4662afaaff2e1344deff)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:55.104925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:55.309105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9abbb0208e4662afaaff2e1344deff'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.309689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9abbb0208e4662afaaff2e1344deff'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.310318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9abbb0208e4662afaaff2e1344deff'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.318245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9abbb0208e4662afaaff2e1344deff'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.373957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9abbb0208e4662afaaff2e1344deff'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.391990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1284/2597] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:55 2022] DELETE /identity/v3/users/ab9abbb0208e4662afaaff2e1344deff => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:55.632440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:55.644143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d036050-c664-4149-acf7-17dd48f52df6 service placement] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:55.707753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:55.708408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:55.708690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:55.708964 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] PATH_INFO: `/v3/projects/f97dc102b5f640ef9945c56f167b92d6` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:55.710099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97dc102b5f640ef9945c56f167b92d6)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:55.711993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:55.820761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97dc102b5f640ef9945c56f167b92d6', 'request_id': 'req-243f5932-9e89-4278-99e9-94dfc4fdaeb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.827370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97dc102b5f640ef9945c56f167b92d6', 'request_id': 'req-243f5932-9e89-4278-99e9-94dfc4fdaeb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.916171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97dc102b5f640ef9945c56f167b92d6', 'request_id': 'req-243f5932-9e89-4278-99e9-94dfc4fdaeb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.922991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:55.927700 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] The token cache is being invalidate because project f97dc102b5f640ef9945c56f167b92d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:55.928002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.928753 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:55.930337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1314/2598] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:55 2022] DELETE /identity/v3/projects/f97dc102b5f640ef9945c56f167b92d6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:55.934342 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:55.935805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:55.948977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5045d64-0b38-4291-8755-4c26767f304b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:55.983496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:56.006296 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:56.006927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:56.007214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:56.007496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] PATH_INFO: `/v3/users/c17059674e2a42c6a149c8d9ead89770` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:56.008665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c17059674e2a42c6a149c8d9ead89770)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:56.010692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:56.181736 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c17059674e2a42c6a149c8d9ead89770'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.182395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c17059674e2a42c6a149c8d9ead89770'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.183013 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c17059674e2a42c6a149c8d9ead89770'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.190527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c17059674e2a42c6a149c8d9ead89770'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.281860 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-589f5f35-7135-49e0-a8b0-c84e1d9e7fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c17059674e2a42c6a149c8d9ead89770'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.300905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1285/2599] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:56:55 2022] DELETE /identity/v3/users/c17059674e2a42c6a149c8d9ead89770 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:56.535617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:56.537168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:56.568885 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f5932-9e89-4278-99e9-94dfc4fdaeb6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:56.628218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:56.631851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:56.631851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:56.631851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] PATH_INFO: `/v3/projects/9a9ee0bbd9934e38a7b970b3d20aee53` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:56.631851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9ee0bbd9934e38a7b970b3d20aee53)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:56.632721 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:56.740839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9ee0bbd9934e38a7b970b3d20aee53', 'request_id': 'req-7a9c3594-0f13-4b23-b819-8f0441215a24'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.746936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9ee0bbd9934e38a7b970b3d20aee53', 'request_id': 'req-7a9c3594-0f13-4b23-b819-8f0441215a24'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.823733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9ee0bbd9934e38a7b970b3d20aee53', 'request_id': 'req-7a9c3594-0f13-4b23-b819-8f0441215a24'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.835218 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] The token cache is being invalidate because project 9a9ee0bbd9934e38a7b970b3d20aee53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:56:56.839458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.839458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-7a9c3594-0f13-4b23-b819-8f0441215a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:56:56.839458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1315/2600] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:56:56 2022] DELETE /identity/v3/projects/9a9ee0bbd9934e38a7b970b3d20aee53 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:56.842830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa397eb-7397-4005-8665-0d11a83180d2 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:56.843323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa397eb-7397-4005-8665-0d11a83180d2 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:56.843428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa397eb-7397-4005-8665-0d11a83180d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:56.863857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-baa397eb-7397-4005-8665-0d11a83180d2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:56.865085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-baa397eb-7397-4005-8665-0d11a83180d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:56.925459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1286/2601] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:56.933159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afde61-1646-445a-9585-d524c599a132 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:56.933723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afde61-1646-445a-9585-d524c599a132 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:56.933723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afde61-1646-445a-9585-d524c599a132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:56.954470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e7afde61-1646-445a-9585-d524c599a132 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:56.955666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e7afde61-1646-445a-9585-d524c599a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:56.963716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1316/2602] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:56.968278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa397eb-7397-4005-8665-0d11a83180d2 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:56.978006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa397eb-7397-4005-8665-0d11a83180d2 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:56.982642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:56.983239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:56.983527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:56.983806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:56.984489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:56:56.984799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:56.986384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:56.998102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1287/2603] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:56:57.002975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afde61-1646-445a-9585-d524c599a132 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.012146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afde61-1646-445a-9585-d524c599a132 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.017775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.018622 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.018917 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.019199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.019898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.022123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:57.119625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1317/2604] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:57 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:57.122327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.133447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702126-14f6-4a9d-ba31-d106e9fc7bdd admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.176126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:57.191064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.191675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.191972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.192270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.192901 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.194823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:57.326568 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1288/2605] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:57 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:57.330800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.341827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856b55a-225f-4c6f-8c91-e76e040a0dff admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.347499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.347499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.347499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.347830 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.348272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.349871 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:57.362167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1318/2606] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:57.365014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.375581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f203c-32ea-4893-aa27-f374729df86e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.380232 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dffc0e-84bf-4694-8f29-f201573533b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.380875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffc0e-84bf-4694-8f29-f201573533b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.381158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffc0e-84bf-4694-8f29-f201573533b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.381437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dffc0e-84bf-4694-8f29-f201573533b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.382087 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dffc0e-84bf-4694-8f29-f201573533b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.383698 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dffc0e-84bf-4694-8f29-f201573533b3 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:57.395260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1289/2607] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:57.399462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.409633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d56df9-e7c2-4af2-9136-ab2f2d457dff admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.414382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.415259 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.415548 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.415828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] PATH_INFO: `/v3/projects/a569d9736e0c4163aa17f7c3c0903c84/users/7d860b6a7fbc4a94869a5ee74730ae11/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.433284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a569d9736e0c4163aa17f7c3c0903c84, user_id=7d860b6a7fbc4a94869a5ee74730ae11, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.436763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:57.511347 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1319/2608] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:57 2022] PUT /identity/v3/projects/a569d9736e0c4163aa17f7c3c0903c84/users/7d860b6a7fbc4a94869a5ee74730ae11/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:57.522905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d876e-ef52-46f9-befc-64d252ddddd0 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.523266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d876e-ef52-46f9-befc-64d252ddddd0 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.525431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d876e-ef52-46f9-befc-64d252ddddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.560458 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-c95d876e-ef52-46f9-befc-64d252ddddd0 None None] MFA Rules not processed for user `7d860b6a7fbc4a94869a5ee74730ae11`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:57.562236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c95d876e-ef52-46f9-befc-64d252ddddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:57.629059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1290/2609] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:57.633628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.660268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:57.695754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445f168-2eb2-49bf-99f9-5a4a09ee7a62 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.700672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.701309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.701594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.701872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.702543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.704489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:57.798609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1320/2610] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:56:57 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:57.802807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d876e-ef52-46f9-befc-64d252ddddd0 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.814166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d876e-ef52-46f9-befc-64d252ddddd0 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.874537 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.875204 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.875480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.875757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.876418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.878336 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:57.967533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1291/2611] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:56:57 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:56:57.971862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:57.982330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024749c9-0709-482f-b5a8-d9c83c908113 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:57.988004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:57.988658 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:57.988989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:57.989273 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:57.989939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:57.991564 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:58.002654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1321/2612] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:58.013330 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:58.023545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523d0a7-bd11-4575-ac59-0e9a82be4c42 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:58.028135 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:58.028806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:58.029086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:58.029389 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] PATH_INFO: `/v3/projects/fe2ab48a84ee4761bebd7aefbbdbd934/users/ad48c2e0c853472e8ebaa6722c483191/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:58.044672 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2ab48a84ee4761bebd7aefbbdbd934, user_id=ad48c2e0c853472e8ebaa6722c483191, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:58.048039 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:58.132823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1292/2613] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:58 2022] PUT /identity/v3/projects/fe2ab48a84ee4761bebd7aefbbdbd934/users/ad48c2e0c853472e8ebaa6722c483191/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:58.136840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:58.146962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beebcb-4798-4d2c-b8c2-a47274022cac admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:58.203338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42feb833-e642-45f7-99f9-44159020f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:58.203948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb833-e642-45f7-99f9-44159020f831 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:58.204261 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb833-e642-45f7-99f9-44159020f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:58.204545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42feb833-e642-45f7-99f9-44159020f831 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:58.205223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feb833-e642-45f7-99f9-44159020f831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:58.206833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42feb833-e642-45f7-99f9-44159020f831 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:58.216672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1322/2614] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:56:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:56:58.221360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:58.232364 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9779-6a42-4cf4-b8de-d0bda8034b77 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:58.237754 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:58.238398 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:58.238679 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:58.238987 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] PATH_INFO: `/v3/projects/fe2ab48a84ee4761bebd7aefbbdbd934/users/ad48c2e0c853472e8ebaa6722c483191/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:58.240914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe2ab48a84ee4761bebd7aefbbdbd934, user_id=ad48c2e0c853472e8ebaa6722c483191, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:58.243673 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:58.254301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1293/2615] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:56:58 2022] PUT /identity/v3/projects/fe2ab48a84ee4761bebd7aefbbdbd934/users/ad48c2e0c853472e8ebaa6722c483191/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:56:58.264579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dff8d-7002-4999-b5b0-0d6e4f72c196 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:58.264877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dff8d-7002-4999-b5b0-0d6e4f72c196 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:58.265167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dff8d-7002-4999-b5b0-0d6e4f72c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:58.294940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-319dff8d-7002-4999-b5b0-0d6e4f72c196 None None] MFA Rules not processed for user `ad48c2e0c853472e8ebaa6722c483191`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:56:58.297041 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-319dff8d-7002-4999-b5b0-0d6e4f72c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:58.366165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1323/2616] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:56:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:56:58.376863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:56:58.378597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:56:58.385185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:56:58.439174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75805fb2-51e5-4e42-8fa5-a361dbadcbe9 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:56:58.442877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:56:58.443477 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:56:58.443764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:56:58.444035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:56:58.501888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:56:58.503353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:56:58.512074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1294/2617] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:56:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:03.898216 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dff8d-7002-4999-b5b0-0d6e4f72c196 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:03.907824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dff8d-7002-4999-b5b0-0d6e4f72c196 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:03.911983 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006d85b-35a5-43f7-a361-34b5259557a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:03.912609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d85b-35a5-43f7-a361-34b5259557a5 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:03.912890 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d85b-35a5-43f7-a361-34b5259557a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:03.913169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d85b-35a5-43f7-a361-34b5259557a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:03.921914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006d85b-35a5-43f7-a361-34b5259557a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:03.923342 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006d85b-35a5-43f7-a361-34b5259557a5 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:03.932702 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1324/2618] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:08.508117 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=46 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:09.989810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:10.053781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16d89c-a0a1-44c5-9f6f-d992df11cb93 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:10.059602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:10.060357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:10.060646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:10.061018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] PATH_INFO: `/v3/users/7d860b6a7fbc4a94869a5ee74730ae11` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:10.062375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d860b6a7fbc4a94869a5ee74730ae11)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:10.064402 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:10.243726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d860b6a7fbc4a94869a5ee74730ae11'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:10.244429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d860b6a7fbc4a94869a5ee74730ae11'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:10.245104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d860b6a7fbc4a94869a5ee74730ae11'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:10.252416 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d860b6a7fbc4a94869a5ee74730ae11'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:10.376875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d860b6a7fbc4a94869a5ee74730ae11'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:10.394822 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1295/2619] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:09 2022] DELETE /identity/v3/users/7d860b6a7fbc4a94869a5ee74730ae11 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:10.399578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:10.400110 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:10.405589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:10.414856 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:10.420851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:10.422314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:10.508229 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1325/2620] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:10.518002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:10.519532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:10.585643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefa46c-8030-4a2a-8c44-80fe4e879034 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:10.589385 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:10.590267 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:10.590545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:10.590814 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:10.599937 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:10.601664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:10.615630 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1296/2621] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:11.097257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:11.100644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:11.129004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d393ea7-5d54-48f5-bb04-e023aa41d165 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:11.133913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:11.134627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:11.135129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:11.135489 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] PATH_INFO: `/v3/projects/a569d9736e0c4163aa17f7c3c0903c84` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:11.136853 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a569d9736e0c4163aa17f7c3c0903c84)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:11.140061 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:11.308605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a569d9736e0c4163aa17f7c3c0903c84', 'request_id': 'req-c52548ed-2a7f-4087-b43c-3098076e6a53'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.314768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a569d9736e0c4163aa17f7c3c0903c84', 'request_id': 'req-c52548ed-2a7f-4087-b43c-3098076e6a53'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.407778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a569d9736e0c4163aa17f7c3c0903c84', 'request_id': 'req-c52548ed-2a7f-4087-b43c-3098076e6a53'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.422572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] The token cache is being invalidate because project a569d9736e0c4163aa17f7c3c0903c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:11.422572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.423655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.425760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1326/2622] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:11 2022] DELETE /identity/v3/projects/a569d9736e0c4163aa17f7c3c0903c84 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:11.429609 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:11.440321 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bd7f5-99c9-449f-afd9-37bf98d4a47f service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:11.472020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:11.511951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:11.512977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:11.512977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:11.513372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] PATH_INFO: `/v3/users/ad48c2e0c853472e8ebaa6722c483191` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:11.514570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad48c2e0c853472e8ebaa6722c483191)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:11.516535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:11.803158 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad48c2e0c853472e8ebaa6722c483191'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.803830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad48c2e0c853472e8ebaa6722c483191'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.804552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad48c2e0c853472e8ebaa6722c483191'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.811491 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad48c2e0c853472e8ebaa6722c483191'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.898965 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a2e7b23b-14b6-45cb-9032-d7eaf8b63f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad48c2e0c853472e8ebaa6722c483191'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:11.916953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1297/2623] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:11 2022] DELETE /identity/v3/users/ad48c2e0c853472e8ebaa6722c483191 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:12.346844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:12.348841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:12.364907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52548ed-2a7f-4087-b43c-3098076e6a53 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:12.422706 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:12.423395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:12.423630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:12.423951 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] PATH_INFO: `/v3/projects/fe2ab48a84ee4761bebd7aefbbdbd934` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:12.425148 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe2ab48a84ee4761bebd7aefbbdbd934)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:12.427816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:12.533285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:12.545439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe2ab48a84ee4761bebd7aefbbdbd934', 'request_id': 'req-0f738697-aff5-46e8-bf53-59dfa6aaddaa'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:12.553037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe2ab48a84ee4761bebd7aefbbdbd934', 'request_id': 'req-0f738697-aff5-46e8-bf53-59dfa6aaddaa'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:12.635691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe2ab48a84ee4761bebd7aefbbdbd934', 'request_id': 'req-0f738697-aff5-46e8-bf53-59dfa6aaddaa'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:12.647154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] The token cache is being invalidate because project fe2ab48a84ee4761bebd7aefbbdbd934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:12.647447 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:12.648091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-0f738697-aff5-46e8-bf53-59dfa6aaddaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:12.649621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1327/2624] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:12 2022] DELETE /identity/v3/projects/fe2ab48a84ee4761bebd7aefbbdbd934 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:12.655573 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887557ed-87a7-44a1-a807-abb9d453e8f6 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:12.656035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887557ed-87a7-44a1-a807-abb9d453e8f6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:12.656145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887557ed-87a7-44a1-a807-abb9d453e8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:12.675861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-887557ed-87a7-44a1-a807-abb9d453e8f6 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:12.677137 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-887557ed-87a7-44a1-a807-abb9d453e8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:12.737581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1298/2625] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:12.747827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2705e-570c-4091-a905-1c2c0d95af2b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:12.748122 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2705e-570c-4091-a905-1c2c0d95af2b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:12.748435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2705e-570c-4091-a905-1c2c0d95af2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:12.768351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-12c2705e-570c-4091-a905-1c2c0d95af2b None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:12.769576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-12c2705e-570c-4091-a905-1c2c0d95af2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:12.778293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1328/2626] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:12.782646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887557ed-87a7-44a1-a807-abb9d453e8f6 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:12.793157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887557ed-87a7-44a1-a807-abb9d453e8f6 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:12.800184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:12.800184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:12.800184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:12.800184 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:12.800674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:12.800674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:12.801768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:12.816382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1299/2627] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:57:12.819862 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2705e-570c-4091-a905-1c2c0d95af2b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:12.831106 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2705e-570c-4091-a905-1c2c0d95af2b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:12.838807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:12.838955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:12.839217 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:12.839494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:12.840464 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:12.842557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:12.981487 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1329/2628] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:12 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:12.985716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:12.998586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149822c-3fee-4be7-b7c0-8f51e2723987 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:13.026616 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:13.056524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:13.057273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.057564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.057923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:13.058553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:13.060574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:13.167942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1300/2629] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:12 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:13.172326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:13.182888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd5f22-cbb3-4a37-8a15-893e1ae88782 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:13.187630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:13.188268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.188619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.192539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:13.192539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:13.192539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:13.201955 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1330/2630] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:13.205978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:13.216923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615bcfa-05de-42b0-b338-08cb5c96b668 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:13.221884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab9201-d987-4513-a721-d1e9f1267584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:13.222502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9201-d987-4513-a721-d1e9f1267584 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.222825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9201-d987-4513-a721-d1e9f1267584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.223064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab9201-d987-4513-a721-d1e9f1267584 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:13.223900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9201-d987-4513-a721-d1e9f1267584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:13.225577 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab9201-d987-4513-a721-d1e9f1267584 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:13.235208 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1301/2631] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:13.239365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:13.249214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8bfcc-db7b-41e4-a97e-e9a427fce132 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:13.255067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:13.255752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.256038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.256373 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] PATH_INFO: `/v3/projects/0aa41efe6ac641fd9e21f698b804d0da/users/4533680d4eef419fbce3cd3f1adb5130/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:13.272610 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa41efe6ac641fd9e21f698b804d0da, user_id=4533680d4eef419fbce3cd3f1adb5130, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:13.275427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:13.369377 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1331/2632] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:13 2022] PUT /identity/v3/projects/0aa41efe6ac641fd9e21f698b804d0da/users/4533680d4eef419fbce3cd3f1adb5130/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:13.440099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c567e2-25ec-489b-9dbe-869590626400 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.440432 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c567e2-25ec-489b-9dbe-869590626400 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.440717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c567e2-25ec-489b-9dbe-869590626400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:13.468436 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b9c567e2-25ec-489b-9dbe-869590626400 None None] MFA Rules not processed for user `4533680d4eef419fbce3cd3f1adb5130`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:13.469657 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b9c567e2-25ec-489b-9dbe-869590626400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:13.533484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1302/2633] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:13.544896 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:13.546660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:13.605938 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450b30-7d02-46ff-ae8a-704400d27ca2 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:13.609608 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed731b0-c241-45f2-84a0-ee268b335e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:13.610207 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed731b0-c241-45f2-84a0-ee268b335e50 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.610488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed731b0-c241-45f2-84a0-ee268b335e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.610761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed731b0-c241-45f2-84a0-ee268b335e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:13.619671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed731b0-c241-45f2-84a0-ee268b335e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:13.621131 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed731b0-c241-45f2-84a0-ee268b335e50 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:13.630394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1332/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:13.654729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c567e2-25ec-489b-9dbe-869590626400 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:13.718655 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c567e2-25ec-489b-9dbe-869590626400 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:13.723852 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:13.724530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.724813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.725091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] PATH_INFO: `/v3/users/4533680d4eef419fbce3cd3f1adb5130` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:13.726266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4533680d4eef419fbce3cd3f1adb5130)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:13.728160 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:13.893783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:13.899480 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4533680d4eef419fbce3cd3f1adb5130'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:13.900141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4533680d4eef419fbce3cd3f1adb5130'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:13.900782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4533680d4eef419fbce3cd3f1adb5130'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:13.907426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4533680d4eef419fbce3cd3f1adb5130'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:13.973675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4533680d4eef419fbce3cd3f1adb5130'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:13.991788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1303/2635] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:13 2022] DELETE /identity/v3/users/4533680d4eef419fbce3cd3f1adb5130 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:13.996224 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:13.996517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:13.996797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:14.015986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:14.017233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:14.070052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:14.081546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1333/2636] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:14.089085 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:14.090730 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:14.163908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466240b-36fd-4604-b313-199bda3f6200 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:14.175873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:14.175873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:14.175873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:14.175873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:14.188914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:14.190378 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:14.203315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1304/2637] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:14.240456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:14.241989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:14.254569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bbb6a-9de2-4c21-b5ff-8fff87e8e4f0 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:14.258409 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ced101-cbb4-4b14-b84d-04e974ee7f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:14.259016 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ced101-cbb4-4b14-b84d-04e974ee7f90 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:14.259299 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ced101-cbb4-4b14-b84d-04e974ee7f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:14.259575 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ced101-cbb4-4b14-b84d-04e974ee7f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:14.261394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e3ced101-cbb4-4b14-b84d-04e974ee7f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:14.280666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ced101-cbb4-4b14-b84d-04e974ee7f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:14.284318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ced101-cbb4-4b14-b84d-04e974ee7f90 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:14.293587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1334/2638] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:14.745857 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:14.747445 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:14.766622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b2311-3cf3-4e76-8979-f5b99d54c0bb service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:14.773455 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:14.774151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:14.774637 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:14.775236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] PATH_INFO: `/v3/projects/0aa41efe6ac641fd9e21f698b804d0da` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:14.776613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa41efe6ac641fd9e21f698b804d0da)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:14.779726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:14.906785 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa41efe6ac641fd9e21f698b804d0da', 'request_id': 'req-8ccb2c59-6240-4201-b09a-2088e30008ea'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:14.913136 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa41efe6ac641fd9e21f698b804d0da', 'request_id': 'req-8ccb2c59-6240-4201-b09a-2088e30008ea'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:14.919419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa41efe6ac641fd9e21f698b804d0da', 'request_id': 'req-8ccb2c59-6240-4201-b09a-2088e30008ea'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:15.036622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] The token cache is being invalidate because project 0aa41efe6ac641fd9e21f698b804d0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:15.036862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:15.037783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ccb2c59-6240-4201-b09a-2088e30008ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:15.039273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1305/2639] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:14 2022] DELETE /identity/v3/projects/0aa41efe6ac641fd9e21f698b804d0da => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:15.044274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f09d-0482-42dc-976d-d927234e7eae None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.045111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f09d-0482-42dc-976d-d927234e7eae None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.045413 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3f09d-0482-42dc-976d-d927234e7eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.065378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-0bb3f09d-0482-42dc-976d-d927234e7eae None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:15.067494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-0bb3f09d-0482-42dc-976d-d927234e7eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:15.127341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1335/2640] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:15.135373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947c1dc-e7eb-43fb-9a4b-13c2b248dd72 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.135741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947c1dc-e7eb-43fb-9a4b-13c2b248dd72 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.136094 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947c1dc-e7eb-43fb-9a4b-13c2b248dd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.156700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-4947c1dc-e7eb-43fb-9a4b-13c2b248dd72 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:15.158153 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4947c1dc-e7eb-43fb-9a4b-13c2b248dd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:15.166533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1306/2641] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:15.170807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3f09d-0482-42dc-976d-d927234e7eae None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.181585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3f09d-0482-42dc-976d-d927234e7eae None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.187522 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.188137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.188444 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.188726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.189380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:15.189722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.191288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.203814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1336/2642] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:15.208172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947c1dc-e7eb-43fb-9a4b-13c2b248dd72 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.217535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947c1dc-e7eb-43fb-9a4b-13c2b248dd72 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.222460 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.223608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.224536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.224536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.224855 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.226795 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.313194 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1307/2643] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:15 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:15.317959 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.330511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac6839-94e4-463c-9438-77f4c1b178f7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.406793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.407458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.407875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.408160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.408892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.411677 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.505014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1337/2644] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:15 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:15.506674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.518186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d9d43-e801-4104-921b-ea8a1cc7a03a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.527241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.527241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.527241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.527241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.527618 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.528111 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.539643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1308/2645] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:15.544099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.555936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5c1ce-0833-410d-ad1a-d1833a5ac78b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.563095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508dc65-7863-4b5b-800c-039f2b5783cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.563801 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dc65-7863-4b5b-800c-039f2b5783cc admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.564158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dc65-7863-4b5b-800c-039f2b5783cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.564539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508dc65-7863-4b5b-800c-039f2b5783cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.565371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508dc65-7863-4b5b-800c-039f2b5783cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.567219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508dc65-7863-4b5b-800c-039f2b5783cc admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.579312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1338/2646] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:15.583963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.590340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:15.597567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a63b-3c6c-42cb-92ba-1c323e0dccac admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.604778 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.605596 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.606000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.606586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] PATH_INFO: `/v3/projects/94b88bf2c34d4766b1caec05f06c35d6/users/c0edc0d5ab34497ab2f3dd15fe319b74/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.625035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94b88bf2c34d4766b1caec05f06c35d6, user_id=c0edc0d5ab34497ab2f3dd15fe319b74, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.628152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.723981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1309/2647] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:15 2022] PUT /identity/v3/projects/94b88bf2c34d4766b1caec05f06c35d6/users/c0edc0d5ab34497ab2f3dd15fe319b74/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:15.735369 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.735754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.736676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.763891 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] MFA Rules not processed for user `c0edc0d5ab34497ab2f3dd15fe319b74`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:15.765379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:15.810077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:15.834714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1339/2648] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:15.846774 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.846938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:15.849192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:15.850050 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:15.909712 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578318b3-02de-484f-a534-31ca4240de31 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.914063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524112b1-b5e0-41d8-863e-42eccc49de8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.914787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524112b1-b5e0-41d8-863e-42eccc49de8d service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.915076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524112b1-b5e0-41d8-863e-42eccc49de8d service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.915354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524112b1-b5e0-41d8-863e-42eccc49de8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.922434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083b1d6a-d704-494f-a9fc-ea09dd689f5b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:15.924081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524112b1-b5e0-41d8-863e-42eccc49de8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.925663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524112b1-b5e0-41d8-863e-42eccc49de8d service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.927284 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:15.927925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:15.928226 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:15.928507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] PATH_INFO: `/v3/users/85080fec05514185ab7164156b0df6d6` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:15.929625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85080fec05514185ab7164156b0df6d6)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:15.931541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:15.936500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1310/2649] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:16.119357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85080fec05514185ab7164156b0df6d6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:16.119357 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85080fec05514185ab7164156b0df6d6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:16.119918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85080fec05514185ab7164156b0df6d6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:16.146196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85080fec05514185ab7164156b0df6d6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:16.241062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85080fec05514185ab7164156b0df6d6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:16.256348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1340/2650] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:15 2022] DELETE /identity/v3/users/85080fec05514185ab7164156b0df6d6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:16.261318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:16.261318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:16.261571 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:16.311794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:16.313212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:16.383397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1311/2651] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:16.388112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:16.389744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:16.462603 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2dc936-19b9-4b92-9fc3-b21a49236b65 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:16.466857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:16.467544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:16.467898 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:16.468277 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:16.480372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:16.485251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:16.502124 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1341/2652] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:16.999285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:17.000735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:17.025156 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514eb00-3f41-46fc-b24e-e5d82c2d31a3 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:17.044638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:17.045426 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:17.045717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:17.045995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] PATH_INFO: `/v3/projects/995546839897470398dfa724ca479ffd` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:17.047322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995546839897470398dfa724ca479ffd)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:17.049429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:17.168165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995546839897470398dfa724ca479ffd', 'request_id': 'req-4b1206ec-277a-44ad-b219-ec5aa9cd5056'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.175780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995546839897470398dfa724ca479ffd', 'request_id': 'req-4b1206ec-277a-44ad-b219-ec5aa9cd5056'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.181601 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995546839897470398dfa724ca479ffd', 'request_id': 'req-4b1206ec-277a-44ad-b219-ec5aa9cd5056'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.270282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] The token cache is being invalidate because project 995546839897470398dfa724ca479ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:17.270797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.271533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4b1206ec-277a-44ad-b219-ec5aa9cd5056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.273292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1312/2653] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:16 2022] DELETE /identity/v3/projects/995546839897470398dfa724ca479ffd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:17.448086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:17.449569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:17.459880 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:17.465966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184406c-2bb1-44a4-80cd-641208c02ed2 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:17.575623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:17.576744 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:17.577202 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:17.581084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] PATH_INFO: `/v3/users/1627b20ac9dc4438b9cb45c5f86cd1bb` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:17.588971 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1627b20ac9dc4438b9cb45c5f86cd1bb)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:17.598515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:17.820748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1627b20ac9dc4438b9cb45c5f86cd1bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.821538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1627b20ac9dc4438b9cb45c5f86cd1bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.822514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1627b20ac9dc4438b9cb45c5f86cd1bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.838115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1627b20ac9dc4438b9cb45c5f86cd1bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.912829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1627b20ac9dc4438b9cb45c5f86cd1bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:17.950387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1342/2654] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:17 2022] DELETE /identity/v3/users/1627b20ac9dc4438b9cb45c5f86cd1bb => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:17.952406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:17.952765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:17.953142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:17.968853 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:17.990817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:17.992132 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:18.090211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1313/2655] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:18.100960 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:18.102980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:18.173440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80873247-e07d-400e-80d1-d73183b5495d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:18.177686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:18.178333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:18.178620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:18.178901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:18.196919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:18.196919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:18.203670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1343/2656] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:18.305911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:18.307608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:18.325523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ee97-1477-4ed8-85e6-196518332d2f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:18.330581 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:18.331370 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:18.331652 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:18.331928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] PATH_INFO: `/v3/users/a844362c07764ff9b43719573f6cdbbb` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:18.333155 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=a844362c07764ff9b43719573f6cdbbb)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:18.335284 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:18.512525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a844362c07764ff9b43719573f6cdbbb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.513270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a844362c07764ff9b43719573f6cdbbb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.513992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a844362c07764ff9b43719573f6cdbbb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.521506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a844362c07764ff9b43719573f6cdbbb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.604742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:18.606806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:18.620563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506da8c5-c014-4d1c-a388-180526326b4b service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:18.625341 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:18.625966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:18.626411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:18.626857 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] PATH_INFO: `/v3/projects/10d008dbe16745f48f53459c2eccbc8c` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:18.628213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d008dbe16745f48f53459c2eccbc8c)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:18.630141 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:18.642854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a844362c07764ff9b43719573f6cdbbb'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.661452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:18.664281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1314/2657] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:18 2022] DELETE /identity/v3/users/a844362c07764ff9b43719573f6cdbbb => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:18.730783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d008dbe16745f48f53459c2eccbc8c', 'request_id': 'req-1093384d-c388-48cb-9c38-08f5d4556496'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.737066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d008dbe16745f48f53459c2eccbc8c', 'request_id': 'req-1093384d-c388-48cb-9c38-08f5d4556496'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.796515 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d008dbe16745f48f53459c2eccbc8c', 'request_id': 'req-1093384d-c388-48cb-9c38-08f5d4556496'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.807821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] The token cache is being invalidate because project 10d008dbe16745f48f53459c2eccbc8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:18.808123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.808815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:18.810338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1344/2658] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:18 2022] DELETE /identity/v3/projects/10d008dbe16745f48f53459c2eccbc8c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:18.814354 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:18.815949 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:18.882671 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d9d17-3dd8-4601-83f5-d9393c4d82ec admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:18.885068 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:18.889563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:18.909048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:18.958569 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:18.959110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:18.959395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:18.959677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] PATH_INFO: `/v3/users/258a05ff946241f796851476c911714f` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:18.961037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=258a05ff946241f796851476c911714f)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:18.962705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093384d-c388-48cb-9c38-08f5d4556496 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:18.962995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:18.968344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:18.968999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:18.969340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:18.969646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] PATH_INFO: `/v3/projects/ce5100ee15654ff7a3510fc8bd6d99b9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:18.970755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5100ee15654ff7a3510fc8bd6d99b9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:18.972695 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:19.135175 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258a05ff946241f796851476c911714f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.135734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5100ee15654ff7a3510fc8bd6d99b9', 'request_id': 'req-e01cee66-5dfd-4131-babe-7f5532c2048b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.135888 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258a05ff946241f796851476c911714f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.136504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258a05ff946241f796851476c911714f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.141597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5100ee15654ff7a3510fc8bd6d99b9', 'request_id': 'req-e01cee66-5dfd-4131-babe-7f5532c2048b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.145532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258a05ff946241f796851476c911714f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.213763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5100ee15654ff7a3510fc8bd6d99b9', 'request_id': 'req-e01cee66-5dfd-4131-babe-7f5532c2048b'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.224698 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] The token cache is being invalidate because project ce5100ee15654ff7a3510fc8bd6d99b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:19.224994 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.225654 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e01cee66-5dfd-4131-babe-7f5532c2048b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.227181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1345/2659] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:18 2022] DELETE /identity/v3/projects/ce5100ee15654ff7a3510fc8bd6d99b9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:19.231776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d5b0-7562-424d-a7cb-cefd3ef17b25 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.232064 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d5b0-7562-424d-a7cb-cefd3ef17b25 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.232397 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d5b0-7562-424d-a7cb-cefd3ef17b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.251286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-3937d5b0-7562-424d-a7cb-cefd3ef17b25 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:19.252552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3937d5b0-7562-424d-a7cb-cefd3ef17b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:19.281974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-fe6c5982-4bf2-4c5f-a0a7-0c2183e529dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258a05ff946241f796851476c911714f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.287365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:19.308998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1315/2660] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:18 2022] DELETE /identity/v3/users/258a05ff946241f796851476c911714f => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:19.316033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1346/2661] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:19.336040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ca0e-1844-46f7-be04-46914257e248 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.336358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ca0e-1844-46f7-be04-46914257e248 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.336641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ca0e-1844-46f7-be04-46914257e248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.356713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-2927ca0e-1844-46f7-be04-46914257e248 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:19.357929 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2927ca0e-1844-46f7-be04-46914257e248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:19.419807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1316/2662] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:19.424170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d5b0-7562-424d-a7cb-cefd3ef17b25 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.435767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d5b0-7562-424d-a7cb-cefd3ef17b25 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.443380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.443988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.444316 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.444592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.445249 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:19.445553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:19.447150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:19.459433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1347/2663] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:19.464080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ca0e-1844-46f7-be04-46914257e248 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.480873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ca0e-1844-46f7-be04-46914257e248 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.485693 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.486487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.486627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.486849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.487484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:19.490091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:19.592752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1317/2664] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:19 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:19.596978 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.607111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dedc3-3099-4fcc-9040-e490ad376323 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.665306 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.665998 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.666191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.666470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.667120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:19.669067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:19.690219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.693688 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:19.708570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ca696-56d2-4ff2-8579-3e89f0ec7299 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.717690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.717690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.717690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.717690 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] PATH_INFO: `/v3/projects/dae0c17df02b4e3ba6a10169f0c05bc8` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.718140 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae0c17df02b4e3ba6a10169f0c05bc8)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:19.719266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:19.735429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1348/2665] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:19 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:19.740387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.741512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:19.758270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d898ef-7674-464a-9628-b1a3e19b33c5 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.762965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.763619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.763903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.764182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.764869 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:19.766511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:19.777282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1349/2666] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:19.781400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.792369 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f5f14-79a7-4fe7-8728-a64e872ccbe4 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.797535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.798137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.798426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.798711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.799358 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:19.801014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:19.812247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae0c17df02b4e3ba6a10169f0c05bc8', 'request_id': 'req-a404c3ff-c7fd-47e2-a457-256826971edd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.813020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1350/2667] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:19.817185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.820513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae0c17df02b4e3ba6a10169f0c05bc8', 'request_id': 'req-a404c3ff-c7fd-47e2-a457-256826971edd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.826381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae0c17df02b4e3ba6a10169f0c05bc8', 'request_id': 'req-a404c3ff-c7fd-47e2-a457-256826971edd'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.828985 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8056dd1a-8c0f-4622-8584-91a90e6b38bb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.880837 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] The token cache is being invalidate because project dae0c17df02b4e3ba6a10169f0c05bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:19.881248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.882055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a404c3ff-c7fd-47e2-a457-256826971edd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:19.883703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1318/2668] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:19 2022] DELETE /identity/v3/projects/dae0c17df02b4e3ba6a10169f0c05bc8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:19.888318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1293f0-3ecc-4b14-b4f3-12b80b81bd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.888475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21074-16e0-49a2-89cd-59359ac475ff None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.888790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21074-16e0-49a2-89cd-59359ac475ff None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.888972 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1293f0-3ecc-4b14-b4f3-12b80b81bd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.889197 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21074-16e0-49a2-89cd-59359ac475ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.889297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1293f0-3ecc-4b14-b4f3-12b80b81bd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.889513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1293f0-3ecc-4b14-b4f3-12b80b81bd3d admin admin] PATH_INFO: `/v3/projects/177b414ba6cb43dca0a10814ae8d9216/users/af39aec3565645068d049f93f0ed6815/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.913037 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-41c21074-16e0-49a2-89cd-59359ac475ff None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:19.914397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-41c21074-16e0-49a2-89cd-59359ac475ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:19.922769 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1319/2669] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:19.931589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb2211-239c-4a6d-a699-66c69d820da8 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.931878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb2211-239c-4a6d-a699-66c69d820da8 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.932157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb2211-239c-4a6d-a699-66c69d820da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.952498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-e0cb2211-239c-4a6d-a699-66c69d820da8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:19.953755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e0cb2211-239c-4a6d-a699-66c69d820da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:19.962126 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1320/2670] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:19.966742 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb2211-239c-4a6d-a699-66c69d820da8 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:19.977080 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb2211-239c-4a6d-a699-66c69d820da8 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:19.982103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:19.982870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:19.995532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:19.995532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:19.995532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:19.995532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:19.995532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.001512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1321/2671] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:20.005816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.016431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34ecd1-3c9d-484c-8bdf-7b6148bff32b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.021469 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.022086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.022427 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.022710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.023371 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.025374 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.027343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1293f0-3ecc-4b14-b4f3-12b80b81bd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=177b414ba6cb43dca0a10814ae8d9216, user_id=af39aec3565645068d049f93f0ed6815, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.030018 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1293f0-3ecc-4b14-b4f3-12b80b81bd3d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.089160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1351/2672] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:19 2022] PUT /identity/v3/projects/177b414ba6cb43dca0a10814ae8d9216/users/af39aec3565645068d049f93f0ed6815/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:20.100282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.100572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.100852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.127508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] MFA Rules not processed for user `af39aec3565645068d049f93f0ed6815`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:20.128760 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:20.133967 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:20.135198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1322/2673] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/projects => generated 401 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:20.139239 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.199214 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1352/2674] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:20.203667 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.204729 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115349a7-3688-482e-9516-be9d7091fdab admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.204991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:20.210241 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.210854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.213548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.213548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.213548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.214014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.284291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a4494-be43-4379-905b-cbfc4b3cedf2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.290369 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1323/2675] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/users => generated 301 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:20.290584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.290584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.290784 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.294754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.294754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.294754 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.297722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.310560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d06b2-7ddc-4d4c-81fe-8c32f9e343a5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.314945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.315549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.315851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.316112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.316845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.318430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.332027 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1324/2676] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:20.334053 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.344482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587120b5-1e08-4ea9-b4d5-f3a1888e3f4f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.350275 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.350868 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.351242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.351428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.352159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.353706 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.364640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1325/2677] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:20.368846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.378300 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb29782-54bf-4e09-8721-2f6f87a0adcc admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.382884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ddec-4938-41b4-a0b0-27f93e96d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.383504 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ddec-4938-41b4-a0b0-27f93e96d59d admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.383862 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ddec-4938-41b4-a0b0-27f93e96d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.384176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ddec-4938-41b4-a0b0-27f93e96d59d admin admin] PATH_INFO: `/v3/projects/68b6c50b8bdb4a0daea265596bbb8da8/users/7510296a565d489584ee034783fcd980/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.392468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1353/2678] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:20.396912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.400278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ddec-4938-41b4-a0b0-27f93e96d59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b6c50b8bdb4a0daea265596bbb8da8, user_id=7510296a565d489584ee034783fcd980, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.403210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ddec-4938-41b4-a0b0-27f93e96d59d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.457186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73125a-611b-4bdc-866d-6591222f1540 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.461247 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:20.462498 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.463104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.463391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.463673 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.464327 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.466750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.466873 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1326/2679] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:20 2022] PUT /identity/v3/projects/68b6c50b8bdb4a0daea265596bbb8da8/users/7510296a565d489584ee034783fcd980/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:20.477397 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b9103-927a-4b96-a5e8-1f805d3079c9 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.477757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b9103-927a-4b96-a5e8-1f805d3079c9 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.478109 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b9103-927a-4b96-a5e8-1f805d3079c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.510304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-a58b9103-927a-4b96-a5e8-1f805d3079c9 None None] MFA Rules not processed for user `7510296a565d489584ee034783fcd980`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:20.510304 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a58b9103-927a-4b96-a5e8-1f805d3079c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:20.571665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1327/2680] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:20.576165 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b9103-927a-4b96-a5e8-1f805d3079c9 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.602223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1354/2681] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/users => generated 309 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:20.606196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.615948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422d825-df05-4a24-ae9f-601687840f9b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.635382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:20.638484 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b9103-927a-4b96-a5e8-1f805d3079c9 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.643200 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.643803 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.644170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.644478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.645807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.647703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.673065 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.673682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.673970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.674250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.674907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.676591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.686371 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1355/2682] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:20.690525 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.700600 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94539e-7a78-4fa6-8486-b416e0c70c65 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.705232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.705844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.706129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.706416 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] PATH_INFO: `/v3/projects/98b573edae634b2db14b577be3567fc7/users/47eb2c6d6c174647a28604cd66c3841d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.721458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b573edae634b2db14b577be3567fc7, user_id=47eb2c6d6c174647a28604cd66c3841d, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.724147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.735206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1328/2683] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/projects => generated 401 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:20.739322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.807991 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87163c25-a275-4729-b1b4-04df74a4e4c8 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.808755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1356/2684] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:20 2022] PUT /identity/v3/projects/98b573edae634b2db14b577be3567fc7/users/47eb2c6d6c174647a28604cd66c3841d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:20.812719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.827070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:20.865245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.865891 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.866170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.866457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.867096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.871583 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.879102 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd8116-e15d-4a56-8567-d1193c0999d9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.881452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.882112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.882390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.882669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.883314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.885025 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.894990 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1357/2685] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:20.899265 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.908628 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3684f1-c3d9-4e70-bafc-38c2224cd7b8 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.913103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc2115-504d-4dfa-9d15-8610ae28de1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:20.913711 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc2115-504d-4dfa-9d15-8610ae28de1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.913991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc2115-504d-4dfa-9d15-8610ae28de1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.914266 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc2115-504d-4dfa-9d15-8610ae28de1e admin admin] PATH_INFO: `/v3/projects/98b573edae634b2db14b577be3567fc7/users/47eb2c6d6c174647a28604cd66c3841d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.916131 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc2115-504d-4dfa-9d15-8610ae28de1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b573edae634b2db14b577be3567fc7, user_id=47eb2c6d6c174647a28604cd66c3841d, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:20.918712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afc2115-504d-4dfa-9d15-8610ae28de1e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:20.929421 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1358/2686] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:20 2022] PUT /identity/v3/projects/98b573edae634b2db14b577be3567fc7/users/47eb2c6d6c174647a28604cd66c3841d/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:20.942587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1329/2687] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/users => generated 307 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:20.942800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:20.942800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:20.942800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:20.944207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:20.954481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15c619-65ad-4030-8463-6fe5a740483b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:20.969858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] MFA Rules not processed for user `47eb2c6d6c174647a28604cd66c3841d`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:20.971063 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.011188 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.011808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.014984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.014984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.014984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.014984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.025347 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1330/2688] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:21.029327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.038325 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1359/2689] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:20 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:21.041190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190adf6-dd74-495e-8fe4-727e94d4a1c6 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.045980 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.046640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.046931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.047217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] PATH_INFO: `/v3/projects/b0cd4b6d3f9944bdbed5eb77238dbd04/users/06e47621e8a84581b5ba235e5135779a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.049625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.051004 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.060961 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:21.063245 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cd4b6d3f9944bdbed5eb77238dbd04, user_id=06e47621e8a84581b5ba235e5135779a, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.069006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.110303 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde7858-94ea-4e5e-a18a-534169fd566a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.114470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.115075 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.115363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.115637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.124517 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.125957 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.135873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1360/2690] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:21 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:21.150223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1331/2691] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:21 2022] PUT /identity/v3/projects/b0cd4b6d3f9944bdbed5eb77238dbd04/users/06e47621e8a84581b5ba235e5135779a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:21.154251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.166154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd5387-b85d-4c70-8734-00f46e4ec057 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.226511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.227121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.227398 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.227676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.228349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.230132 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.241541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1361/2692] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:21.246170 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.256776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b13395-1f4d-4cbf-b4a0-e9d420965f82 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.262041 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ca5b1-3f00-4960-8087-b72a0caf3668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.262811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca5b1-3f00-4960-8087-b72a0caf3668 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.263097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca5b1-3f00-4960-8087-b72a0caf3668 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.263379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ca5b1-3f00-4960-8087-b72a0caf3668 admin admin] PATH_INFO: `/v3/projects/b0cd4b6d3f9944bdbed5eb77238dbd04/users/06e47621e8a84581b5ba235e5135779a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.265357 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ca5b1-3f00-4960-8087-b72a0caf3668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cd4b6d3f9944bdbed5eb77238dbd04, user_id=06e47621e8a84581b5ba235e5135779a, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.268264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ca5b1-3f00-4960-8087-b72a0caf3668 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.277114 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.279035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1332/2693] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:21 2022] PUT /identity/v3/projects/b0cd4b6d3f9944bdbed5eb77238dbd04/users/06e47621e8a84581b5ba235e5135779a/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:21.288236 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2c4f1-70c1-4954-bd24-000c30eb3aeb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.292553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.293319 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.293983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.328624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] MFA Rules not processed for user `06e47621e8a84581b5ba235e5135779a`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:21.330159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.362625 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.363314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.364188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.364531 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] PATH_INFO: `/v3/users/af39aec3565645068d049f93f0ed6815` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.366241 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=af39aec3565645068d049f93f0ed6815)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.368209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.407848 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:21.418401 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1333/2694] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:21 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:21.429741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.431172 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.492584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92112e6f-419e-465e-b64e-8bcb470a8b47 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.496266 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84001bd-cfc5-4eeb-84d4-a55b447d05f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.496881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84001bd-cfc5-4eeb-84d4-a55b447d05f3 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.497167 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84001bd-cfc5-4eeb-84d4-a55b447d05f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.497448 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84001bd-cfc5-4eeb-84d4-a55b447d05f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.506478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84001bd-cfc5-4eeb-84d4-a55b447d05f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.507907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84001bd-cfc5-4eeb-84d4-a55b447d05f3 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.517925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1334/2695] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:21 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:21.536556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:21.546505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af39aec3565645068d049f93f0ed6815'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:21.547181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af39aec3565645068d049f93f0ed6815'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:21.547818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af39aec3565645068d049f93f0ed6815'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:21.560144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af39aec3565645068d049f93f0ed6815'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:21.626526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af39aec3565645068d049f93f0ed6815'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:21.641099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1362/2696] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:21 2022] DELETE /identity/v3/users/af39aec3565645068d049f93f0ed6815 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:21.646018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.646379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.646732 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.666552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:21.667847 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.732972 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1335/2697] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:21.740533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.742175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.744015 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:21.745457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.811514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a774c-2df1-48d7-b8aa-751e5151efbb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.813894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e4978-ee90-4724-b2d2-e791cb09e48f None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:21.815411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.816156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.816669 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.817023 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.817896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:21.818509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:21.818939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:21.819221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:21.821043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:21.826980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.828451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.839036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1363/2698] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:21.887009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:21.889667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:21.898863 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:21.901395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1336/2699] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:21 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:22.257196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:22.258726 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:22.273269 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88606487-21ab-42cb-a31b-7b3a58cbe89a service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:22.278674 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:22.284858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:22.284858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:22.284858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] PATH_INFO: `/v3/projects/177b414ba6cb43dca0a10814ae8d9216` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:22.284858 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=177b414ba6cb43dca0a10814ae8d9216)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:22.288923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:22.413074 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '177b414ba6cb43dca0a10814ae8d9216', 'request_id': 'req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.419096 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '177b414ba6cb43dca0a10814ae8d9216', 'request_id': 'req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.493503 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '177b414ba6cb43dca0a10814ae8d9216', 'request_id': 'req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.506822 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] The token cache is being invalidate because project 177b414ba6cb43dca0a10814ae8d9216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:22.507170 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.507828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.509387 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1364/2700] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:22 2022] DELETE /identity/v3/projects/177b414ba6cb43dca0a10814ae8d9216 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:22.513713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:22.527219 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175a2be-f5d2-4ae2-86fb-964edeaeaeee service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:22.595086 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:22.597341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:22.597341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:22.597341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] PATH_INFO: `/v3/users/47eb2c6d6c174647a28604cd66c3841d` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:22.597705 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47eb2c6d6c174647a28604cd66c3841d)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:22.599413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:22.776395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47eb2c6d6c174647a28604cd66c3841d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.777054 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47eb2c6d6c174647a28604cd66c3841d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.777733 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47eb2c6d6c174647a28604cd66c3841d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.785358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47eb2c6d6c174647a28604cd66c3841d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.865286 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-86c1a190-1e30-4eda-a574-85c2dad3bc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47eb2c6d6c174647a28604cd66c3841d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:22.884050 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1337/2701] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:22 2022] DELETE /identity/v3/users/47eb2c6d6c174647a28604cd66c3841d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:23.302223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:23.303849 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:23.319403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29f2fa-82c1-48ba-8e86-1ef59e331f55 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:23.373013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:23.385991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:23.386617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:23.386899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:23.387174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] PATH_INFO: `/v3/projects/98b573edae634b2db14b577be3567fc7` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:23.388334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b573edae634b2db14b577be3567fc7)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:23.390345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:23.482934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b573edae634b2db14b577be3567fc7', 'request_id': 'req-c01f838f-e6bd-44de-9ff5-9c1a37878e69'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:23.489394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b573edae634b2db14b577be3567fc7', 'request_id': 'req-c01f838f-e6bd-44de-9ff5-9c1a37878e69'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:23.544878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b573edae634b2db14b577be3567fc7', 'request_id': 'req-c01f838f-e6bd-44de-9ff5-9c1a37878e69'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:23.556020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] The token cache is being invalidate because project 98b573edae634b2db14b577be3567fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:23.556351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:23.557093 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c01f838f-e6bd-44de-9ff5-9c1a37878e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:23.558626 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1365/2702] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:23 2022] DELETE /identity/v3/projects/98b573edae634b2db14b577be3567fc7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:23.563985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de406e05-453d-422b-bc02-3ec2ed0a687a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:23.564495 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de406e05-453d-422b-bc02-3ec2ed0a687a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:23.564734 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de406e05-453d-422b-bc02-3ec2ed0a687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:23.587344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-de406e05-453d-422b-bc02-3ec2ed0a687a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:23.592033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-de406e05-453d-422b-bc02-3ec2ed0a687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:23.654744 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1338/2703] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:23.663142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57a5d-5c38-480f-99cd-93b3d6a6f0d3 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:23.663431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57a5d-5c38-480f-99cd-93b3d6a6f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:23.663709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57a5d-5c38-480f-99cd-93b3d6a6f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:23.685281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-19f57a5d-5c38-480f-99cd-93b3d6a6f0d3 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:23.686494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-19f57a5d-5c38-480f-99cd-93b3d6a6f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:23.698359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1366/2704] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:23.699559 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de406e05-453d-422b-bc02-3ec2ed0a687a None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:23.710638 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de406e05-453d-422b-bc02-3ec2ed0a687a None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:23.716840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:23.717429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:23.717710 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:23.718006 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:23.718636 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:23.718940 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:23.720554 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:23.729584 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:23.733212 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1339/2705] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:57:23.738191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57a5d-5c38-480f-99cd-93b3d6a6f0d3 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:23.747543 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57a5d-5c38-480f-99cd-93b3d6a6f0d3 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:23.753308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:23.753935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:23.754719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:23.754996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:23.755670 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:23.758507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:23.866292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1367/2706] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:23 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:23.867413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:23.877301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba22e014-6225-42b5-8bde-61146513b619 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:23.932914 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:23.933518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:23.933808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:23.934082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:23.934703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:23.936650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.025017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1340/2707] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:23 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:24.029385 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:24.039501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d7d5b-b499-4008-bccf-e70a25e5a14b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:24.044656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:24.044859 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.045120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.045392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.046031 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:24.047886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.058317 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1368/2708] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:24.062527 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:24.072979 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29b5f9-8cc2-43be-85ea-65033fa978db admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:24.077558 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df9169-420b-413b-a598-bece944aed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:24.078148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9169-420b-413b-a598-bece944aed8b admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.078429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9169-420b-413b-a598-bece944aed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.078704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9169-420b-413b-a598-bece944aed8b admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.079344 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9169-420b-413b-a598-bece944aed8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:24.080990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9169-420b-413b-a598-bece944aed8b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.091807 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1341/2709] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:24.095810 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:24.105722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880213-39f6-4ca9-98a5-975d7a28da6f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:24.110304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:24.110947 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.111231 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.111512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] PATH_INFO: `/v3/projects/1109969d0f4e49c181dbeb5c94e87b99/users/7defda76910040eaad3419553166b217/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.128359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1109969d0f4e49c181dbeb5c94e87b99, user_id=7defda76910040eaad3419553166b217, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:24.131716 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.219040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1369/2710] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:24 2022] PUT /identity/v3/projects/1109969d0f4e49c181dbeb5c94e87b99/users/7defda76910040eaad3419553166b217/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:24.229646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2b43c-f4e2-4c85-86aa-114fe7ac5ebc None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.229933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2b43c-f4e2-4c85-86aa-114fe7ac5ebc None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.230217 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2b43c-f4e2-4c85-86aa-114fe7ac5ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.257818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-acf2b43c-f4e2-4c85-86aa-114fe7ac5ebc None None] MFA Rules not processed for user `7defda76910040eaad3419553166b217`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:24.259040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-acf2b43c-f4e2-4c85-86aa-114fe7ac5ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:24.324720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1342/2711] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:24.329222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:24.391919 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a1ff9-4717-47aa-b91a-c9c8294b004a admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:24.396884 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:24.397482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.397764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.398066 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.398742 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:24.400701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.477104 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:24.484159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1370/2712] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:24 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:24.488144 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2b43c-f4e2-4c85-86aa-114fe7ac5ebc None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:24.499386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2b43c-f4e2-4c85-86aa-114fe7ac5ebc None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:24.558169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:24.558786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.559076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.559352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.559998 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:24.561985 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.842818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:24.849513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1343/2713] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:24 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:24.858036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:24.868045 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136d313-d5d4-4d49-bb51-7a7dbe8fa562 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:24.872554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:24.873145 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.873425 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.873699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.874356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:24.876219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.886513 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1371/2714] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:24.890387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:24.901028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cf600-70ac-402e-8c11-462a4965f1a0 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:24.905797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:24.906451 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:24.906739 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:24.907018 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] PATH_INFO: `/v3/projects/d88394a6834a4abd8b6ad093774dc109/users/39cbb54a9de849409cc24ed0f9c90d52/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:24.923938 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88394a6834a4abd8b6ad093774dc109, user_id=39cbb54a9de849409cc24ed0f9c90d52, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:24.926782 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:24.993353 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1344/2715] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:24 2022] PUT /identity/v3/projects/d88394a6834a4abd8b6ad093774dc109/users/39cbb54a9de849409cc24ed0f9c90d52/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:24.997477 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:25.007921 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb35bc-1911-47b5-be5e-492f69f567d1 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:25.061953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ad0b9-b5f5-4b39-bcfa-b16ba1e350bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:25.062544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad0b9-b5f5-4b39-bcfa-b16ba1e350bd admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:25.062827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad0b9-b5f5-4b39-bcfa-b16ba1e350bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:25.063100 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ad0b9-b5f5-4b39-bcfa-b16ba1e350bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:25.063779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ad0b9-b5f5-4b39-bcfa-b16ba1e350bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:25.065396 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ad0b9-b5f5-4b39-bcfa-b16ba1e350bd admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:25.075355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1372/2716] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:25.079516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:25.090549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c58e98-eea3-40cd-9c6e-b41173a39f35 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:25.095088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:25.095674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:25.095953 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:25.096307 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] PATH_INFO: `/v3/projects/d88394a6834a4abd8b6ad093774dc109/users/39cbb54a9de849409cc24ed0f9c90d52/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:25.098218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d88394a6834a4abd8b6ad093774dc109, user_id=39cbb54a9de849409cc24ed0f9c90d52, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:25.100952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:25.111028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1345/2717] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:25 2022] PUT /identity/v3/projects/d88394a6834a4abd8b6ad093774dc109/users/39cbb54a9de849409cc24ed0f9c90d52/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:25.122402 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:25.122692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:25.122975 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:25.157693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] MFA Rules not processed for user `39cbb54a9de849409cc24ed0f9c90d52`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:25.157693 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:25.227103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1373/2718] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:25.238305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:25.240301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:25.309542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92968fae-51b2-40a8-a6a1-a7c64554dc2d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:25.313298 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937bc94-5e7f-4a60-a1df-b304c3bfb4d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:25.313970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937bc94-5e7f-4a60-a1df-b304c3bfb4d5 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:25.317301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937bc94-5e7f-4a60-a1df-b304c3bfb4d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:25.317301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937bc94-5e7f-4a60-a1df-b304c3bfb4d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:25.324975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937bc94-5e7f-4a60-a1df-b304c3bfb4d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:25.326447 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0937bc94-5e7f-4a60-a1df-b304c3bfb4d5 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:25.336283 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1346/2719] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:27.044624 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:27.046126 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:27.114108 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd66d5e-c274-43cc-a83b-51ab2cbe53a1 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:27.119105 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:27.119727 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:27.120006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:27.120308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] PATH_INFO: `/v3/users/7510296a565d489584ee034783fcd980` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:27.121411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7510296a565d489584ee034783fcd980)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:27.123442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:27.134379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:27.323743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7510296a565d489584ee034783fcd980'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.324422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7510296a565d489584ee034783fcd980'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.325028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7510296a565d489584ee034783fcd980'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.336415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7510296a565d489584ee034783fcd980'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.419304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7510296a565d489584ee034783fcd980'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.433616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1374/2720] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:27 2022] DELETE /identity/v3/users/7510296a565d489584ee034783fcd980 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:27.438691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:27.439166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:27.439295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:27.458025 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:27.459213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:27.517668 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1347/2721] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:27.527968 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:27.529350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:27.566979 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:27.576846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:27.581622 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dae486-cea6-4c54-996d-9262fc222254 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:27.587352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:27.587992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:27.588316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:27.588588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] PATH_INFO: `/v3/users/c0edc0d5ab34497ab2f3dd15fe319b74` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:27.590543 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0edc0d5ab34497ab2f3dd15fe319b74)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:27.592930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:27.610563 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca6f29-4283-4139-a915-32637b407647 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:27.615907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bcd8f1-849d-4607-a627-607ae64ed2a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:27.616599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcd8f1-849d-4607-a627-607ae64ed2a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:27.616867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcd8f1-849d-4607-a627-607ae64ed2a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:27.617152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bcd8f1-849d-4607-a627-607ae64ed2a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:27.627569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcd8f1-849d-4607-a627-607ae64ed2a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:27.629088 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bcd8f1-849d-4607-a627-607ae64ed2a9 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:27.639684 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1375/2722] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:27.781879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0edc0d5ab34497ab2f3dd15fe319b74'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.782488 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0edc0d5ab34497ab2f3dd15fe319b74'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.783113 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0edc0d5ab34497ab2f3dd15fe319b74'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.790513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0edc0d5ab34497ab2f3dd15fe319b74'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.793011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:27.877787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0edc0d5ab34497ab2f3dd15fe319b74'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:27.913772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1348/2723] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:27 2022] DELETE /identity/v3/users/c0edc0d5ab34497ab2f3dd15fe319b74 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:27.918506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:27.918798 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:27.919073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:27.944710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:27.945916 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:28.009556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1376/2724] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:28.019095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:28.020524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:28.079014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5038f-9edc-4a0f-8a05-0deb4759a64c admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:28.085554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:28.086036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:28.088327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:28.088327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:28.088327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:28.088803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:28.099278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:28.101070 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:28.102909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc12b74-9a2d-4a5b-b843-0d65f762804d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:28.108573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:28.111112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:28.111112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:28.111112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] PATH_INFO: `/v3/projects/68b6c50b8bdb4a0daea265596bbb8da8` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:28.111939 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b6c50b8bdb4a0daea265596bbb8da8)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:28.112758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1349/2725] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:28.114134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:28.244301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:28.260965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b6c50b8bdb4a0daea265596bbb8da8', 'request_id': 'req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.267129 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b6c50b8bdb4a0daea265596bbb8da8', 'request_id': 'req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.365582 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:28.367055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:28.368833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b6c50b8bdb4a0daea265596bbb8da8', 'request_id': 'req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.379836 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4b0b0-4d08-40a8-99a4-8e7631e2e514 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:28.383099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] The token cache is being invalidate because project 68b6c50b8bdb4a0daea265596bbb8da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:28.384185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.385637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.387267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1377/2726] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:28 2022] DELETE /identity/v3/projects/68b6c50b8bdb4a0daea265596bbb8da8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:28.391776 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:28.393786 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:28.445133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:28.445879 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:28.446211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:28.446496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] PATH_INFO: `/v3/users/7defda76910040eaad3419553166b217` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:28.447635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7defda76910040eaad3419553166b217)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:28.449570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:28.460657 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef7f5d-8c9a-4d11-a01b-83c380368b3e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:28.465661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:28.466335 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:28.470650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:28.470650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] PATH_INFO: `/v3/users/06e47621e8a84581b5ba235e5135779a` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:28.470650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e47621e8a84581b5ba235e5135779a)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:28.470650 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:28.701759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7defda76910040eaad3419553166b217'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.702502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7defda76910040eaad3419553166b217'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.703120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7defda76910040eaad3419553166b217'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.710043 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7defda76910040eaad3419553166b217'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.735405 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e47621e8a84581b5ba235e5135779a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.736044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e47621e8a84581b5ba235e5135779a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.736679 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e47621e8a84581b5ba235e5135779a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.748579 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e47621e8a84581b5ba235e5135779a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.801058 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7defda76910040eaad3419553166b217'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.814576 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:28.819858 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1350/2727] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:28 2022] DELETE /identity/v3/users/7defda76910040eaad3419553166b217 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:28.820497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:28.821823 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:28.881442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9c80d28f-8e06-48fe-8d34-576ae59db82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e47621e8a84581b5ba235e5135779a'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:28.885046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69bed6-45fc-4139-8e3c-b29dcbf19c5f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:28.889757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:28.890414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:28.890721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:28.891000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] PATH_INFO: `/v3/projects/94b88bf2c34d4766b1caec05f06c35d6` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:28.892211 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94b88bf2c34d4766b1caec05f06c35d6)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:28.894118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:28.894729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1378/2728] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:28 2022] DELETE /identity/v3/users/06e47621e8a84581b5ba235e5135779a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:28.898901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:28.899190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:28.899470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:28.922652 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:28.923894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:28.981681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1379/2729] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:28.992453 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:28.993803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:29.024572 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94b88bf2c34d4766b1caec05f06c35d6', 'request_id': 'req-f73c117d-0780-41eb-92de-c3527256e002'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.030772 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94b88bf2c34d4766b1caec05f06c35d6', 'request_id': 'req-f73c117d-0780-41eb-92de-c3527256e002'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.036318 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94b88bf2c34d4766b1caec05f06c35d6', 'request_id': 'req-f73c117d-0780-41eb-92de-c3527256e002'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.049239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b51f6-4f8f-4062-aed6-a23e36932c8a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:29.097238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb802e0-5cf0-41e6-a983-b4460706e4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:29.097954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb802e0-5cf0-41e6-a983-b4460706e4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.098171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb802e0-5cf0-41e6-a983-b4460706e4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.098486 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb802e0-5cf0-41e6-a983-b4460706e4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.118933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] The token cache is being invalidate because project 94b88bf2c34d4766b1caec05f06c35d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:29.119240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.120444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.122727 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1351/2730] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:28 2022] DELETE /identity/v3/projects/94b88bf2c34d4766b1caec05f06c35d6 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:29.173103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb802e0-5cf0-41e6-a983-b4460706e4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:29.174913 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb802e0-5cf0-41e6-a983-b4460706e4e2 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:29.186762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1380/2731] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:29.237718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:29.375996 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:29.377456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:29.391122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c117d-0780-41eb-92de-c3527256e002 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:29.396768 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:29.401047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.401047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.401047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] PATH_INFO: `/v3/projects/b0cd4b6d3f9944bdbed5eb77238dbd04` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.401047 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cd4b6d3f9944bdbed5eb77238dbd04)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:29.401849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:29.528824 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cd4b6d3f9944bdbed5eb77238dbd04', 'request_id': 'req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.535122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cd4b6d3f9944bdbed5eb77238dbd04', 'request_id': 'req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.541012 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cd4b6d3f9944bdbed5eb77238dbd04', 'request_id': 'req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.629826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] The token cache is being invalidate because project b0cd4b6d3f9944bdbed5eb77238dbd04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:29.630121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.631234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.632792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1352/2732] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:29 2022] DELETE /identity/v3/projects/b0cd4b6d3f9944bdbed5eb77238dbd04 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:29.637685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb31c7-dd73-4594-a3bc-bc9bfc5f13a1 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.637980 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb31c7-dd73-4594-a3bc-bc9bfc5f13a1 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.638262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb31c7-dd73-4594-a3bc-bc9bfc5f13a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.658077 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-34cb31c7-dd73-4594-a3bc-bc9bfc5f13a1 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:29.659282 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-34cb31c7-dd73-4594-a3bc-bc9bfc5f13a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:29.663767 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:29.665452 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:29.690169 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:29.721035 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1381/2733] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:29.728838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993f53-09ea-4b11-b162-5be824033331 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.729238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993f53-09ea-4b11-b162-5be824033331 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.729524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98993f53-09ea-4b11-b162-5be824033331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.744063 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49ca4-9c14-4a45-bc84-4caeb8dec14b admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:29.748380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-98993f53-09ea-4b11-b162-5be824033331 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:29.748784 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:29.749413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.749545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-98993f53-09ea-4b11-b162-5be824033331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:29.749696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.749969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] PATH_INFO: `/v3/projects/1109969d0f4e49c181dbeb5c94e87b99` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.751121 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] RBAC: Authorizing `identity:delete_project(project_id=1109969d0f4e49c181dbeb5c94e87b99)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:29.753143 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:29.757992 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1382/2734] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:29.762073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993f53-09ea-4b11-b162-5be824033331 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:29.770987 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98993f53-09ea-4b11-b162-5be824033331 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:29.776111 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:29.776723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.777006 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.777281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.778060 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:29.778372 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:29.779953 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:29.791338 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1383/2735] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:29.795482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:29.805795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216e6cf-a263-4bbd-8cc2-f68b2db7812c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:29.810449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:29.811015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.811298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.811576 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.812239 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:29.814153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:29.875870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1109969d0f4e49c181dbeb5c94e87b99', 'request_id': 'req-cdb9a507-dd5a-4115-a41a-89c5ce7969df'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.882617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1109969d0f4e49c181dbeb5c94e87b99', 'request_id': 'req-cdb9a507-dd5a-4115-a41a-89c5ce7969df'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.887925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1109969d0f4e49c181dbeb5c94e87b99', 'request_id': 'req-cdb9a507-dd5a-4115-a41a-89c5ce7969df'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:29.922482 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1384/2736] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:29 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:29.926461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:29.987351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c0132-87ad-4b68-9149-c6939981f4e9 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:29.993291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:29.999704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:29.999704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:29.999704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:29.999704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.000102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] The token cache is being invalidate because project 1109969d0f4e49c181dbeb5c94e87b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:30.000102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.000102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.000389 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.000524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1353/2737] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:29 2022] DELETE /identity/v3/projects/1109969d0f4e49c181dbeb5c94e87b99 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:30.002074 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.003377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:30.065597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9a507-dd5a-4115-a41a-89c5ce7969df admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.070957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.071589 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.071874 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.072157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] PATH_INFO: `/v3/users/39cbb54a9de849409cc24ed0f9c90d52` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.073509 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cbb54a9de849409cc24ed0f9c90d52)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.075437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.076569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1385/2738] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:29 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:30.080454 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.083046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:30.094144 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbed03-76c0-4f81-80a2-c582ef62a2a3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.098748 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.099365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.099646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.099922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.100612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.102196 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.111948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1386/2739] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:30.116589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.122656 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:30.127554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398d4dc-e809-4dd1-a720-f807e148f097 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.132471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.133046 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.133344 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.133609 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.134271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.135929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.147313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1387/2740] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:30.151190 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.160324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fefdd3-b620-4cc7-91c8-9a4f61e142e6 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.165399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e12829-1cec-4202-b0e8-85a2e3920161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.166039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e12829-1cec-4202-b0e8-85a2e3920161 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.166318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e12829-1cec-4202-b0e8-85a2e3920161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.166591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e12829-1cec-4202-b0e8-85a2e3920161 admin admin] PATH_INFO: `/v3/projects/6163fdeb9a7c4a86b0adb067600910cd/users/00597febcba041479e395f1a755d7ece/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.180883 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e12829-1cec-4202-b0e8-85a2e3920161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6163fdeb9a7c4a86b0adb067600910cd, user_id=00597febcba041479e395f1a755d7ece, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.185598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e12829-1cec-4202-b0e8-85a2e3920161 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.237564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cbb54a9de849409cc24ed0f9c90d52'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.238240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cbb54a9de849409cc24ed0f9c90d52'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.238854 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cbb54a9de849409cc24ed0f9c90d52'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.246375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cbb54a9de849409cc24ed0f9c90d52'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.259296 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1388/2741] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:30 2022] PUT /identity/v3/projects/6163fdeb9a7c4a86b0adb067600910cd/users/00597febcba041479e395f1a755d7ece/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:30.270874 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b4d1e-1a5d-4710-be94-bc67d185d17a None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.271159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b4d1e-1a5d-4710-be94-bc67d185d17a None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.271438 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b4d1e-1a5d-4710-be94-bc67d185d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.299318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-535b4d1e-1a5d-4710-be94-bc67d185d17a None None] MFA Rules not processed for user `00597febcba041479e395f1a755d7ece`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:30.300558 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-535b4d1e-1a5d-4710-be94-bc67d185d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:30.322407 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cbb54a9de849409cc24ed0f9c90d52'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.341033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1354/2742] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:30 2022] DELETE /identity/v3/users/39cbb54a9de849409cc24ed0f9c90d52 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:30.356113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:30.365554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1389/2743] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:30.370122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.371555 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:30.426765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:30.439536 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d0c36-7c14-41bb-8f69-5a45014be1a4 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.444339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.444947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.445340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.445627 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.446274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.448186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.546779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1355/2744] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:30 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:30.550988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b4d1e-1a5d-4710-be94-bc67d185d17a None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.616257 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b4d1e-1a5d-4710-be94-bc67d185d17a None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.674736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.675378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.675661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.675937 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.676599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.678510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.780524 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1390/2745] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:30 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:30.780792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.782482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:30.790147 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.796689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1827610-4fea-48e9-bdeb-c1f0acdb59c2 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.799156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ce47d-aed8-47bd-9f90-46ecd38eba83 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.802478 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.803493 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.803879 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.804400 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.804542 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.804779 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.805055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.805331 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] PATH_INFO: `/v3/projects/d88394a6834a4abd8b6ad093774dc109` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.805731 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.807110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d88394a6834a4abd8b6ad093774dc109)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.807415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.809235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.817807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1391/2746] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:30.821794 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.831569 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71dab2-bb58-44aa-98d4-38eaa781fcd2 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:30.837062 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:30.837705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:30.837991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:30.838267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] PATH_INFO: `/v3/projects/d51b10e8bec540f99f66f8a8aad9a2e2/users/4c5dd3c99039424cae93589c0f04ce41/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:30.853793 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51b10e8bec540f99f66f8a8aad9a2e2, user_id=4c5dd3c99039424cae93589c0f04ce41, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:30.856435 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:30.939247 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1392/2747] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:30 2022] PUT /identity/v3/projects/d51b10e8bec540f99f66f8a8aad9a2e2/users/4c5dd3c99039424cae93589c0f04ce41/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:30.943817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:30.947974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd88394a6834a4abd8b6ad093774dc109', 'request_id': 'req-94236d00-3488-4b3f-9ea2-3b05e5072979'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.954725 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd88394a6834a4abd8b6ad093774dc109', 'request_id': 'req-94236d00-3488-4b3f-9ea2-3b05e5072979'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.961339 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd88394a6834a4abd8b6ad093774dc109', 'request_id': 'req-94236d00-3488-4b3f-9ea2-3b05e5072979'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:30.977795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:31.004013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e74d50-5684-45d3-b6f8-a1818bcbfe9f admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.056870 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.057581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.057866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.058140 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.058775 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.060415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.070355 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1393/2748] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:31.074079 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] The token cache is being invalidate because project d88394a6834a4abd8b6ad093774dc109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:31.074387 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:31.074506 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.075095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-94236d00-3488-4b3f-9ea2-3b05e5072979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:31.076651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1356/2749] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:30 2022] DELETE /identity/v3/projects/d88394a6834a4abd8b6ad093774dc109 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:31.076936 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:31.081240 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b1346-7542-4e79-aea4-1d75a336900a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.081530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b1346-7542-4e79-aea4-1d75a336900a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.081897 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b1346-7542-4e79-aea4-1d75a336900a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.090030 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36544671-bb0b-47e6-961c-be2df4db868e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.095256 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a758a1-e45c-4af8-9242-3a33bab54945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.095934 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a758a1-e45c-4af8-9242-3a33bab54945 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.096314 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a758a1-e45c-4af8-9242-3a33bab54945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.096617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a758a1-e45c-4af8-9242-3a33bab54945 admin admin] PATH_INFO: `/v3/projects/d51b10e8bec540f99f66f8a8aad9a2e2/users/4c5dd3c99039424cae93589c0f04ce41/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.098623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a758a1-e45c-4af8-9242-3a33bab54945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51b10e8bec540f99f66f8a8aad9a2e2, user_id=4c5dd3c99039424cae93589c0f04ce41, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.101468 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a758a1-e45c-4af8-9242-3a33bab54945 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.102030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-360b1346-7542-4e79-aea4-1d75a336900a None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:31.103017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-360b1346-7542-4e79-aea4-1d75a336900a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:31.111415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1357/2750] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:31.111792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1394/2751] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:31 2022] PUT /identity/v3/projects/d51b10e8bec540f99f66f8a8aad9a2e2/users/4c5dd3c99039424cae93589c0f04ce41/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:31.121128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951e7e-a234-4a8d-aa64-d9a2ee82b995 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.121410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951e7e-a234-4a8d-aa64-d9a2ee82b995 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.121693 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92951e7e-a234-4a8d-aa64-d9a2ee82b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.121809 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.121989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.122408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.141492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-92951e7e-a234-4a8d-aa64-d9a2ee82b995 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:31.142713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-92951e7e-a234-4a8d-aa64-d9a2ee82b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:31.150638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] MFA Rules not processed for user `4c5dd3c99039424cae93589c0f04ce41`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:31.151833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:31.159775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:31.202718 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1358/2752] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:31.206918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92951e7e-a234-4a8d-aa64-d9a2ee82b995 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.216810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92951e7e-a234-4a8d-aa64-d9a2ee82b995 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.221750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.222195 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1395/2753] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:31.222341 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.222709 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.222993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.223683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:31.224249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.229412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.238201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1359/2754] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:31.239734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.241379 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:31.242201 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.251629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da786d1-86f2-44e7-bab7-a313bba16a02 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.256842 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.258103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.258103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.258103 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.258552 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.260459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.294637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:31.298466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5ce5b-a87c-498b-b612-939e34d2708f None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.302803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.303449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.303755 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.304033 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.313092 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.314474 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.324320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1396/2755] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:31.369233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1360/2756] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:31 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:31.373090 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.384281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63f0ce3-3f8a-4363-be61-074cf9676f0c service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.444055 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.444875 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.445230 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.445598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.446223 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.448472 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.474948 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.529481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e0e76-c4a4-4216-819a-e258c367f8ea admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.533114 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.533711 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.533992 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.534268 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.535961 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:31.557021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1397/2757] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:31 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:31.561002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.570954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f463-ee6f-41a6-a286-2a3b0eceef15 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.575797 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.576430 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.576717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.577027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.577714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.579318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.589922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1398/2758] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:31.594169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.600957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.602629 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.604080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e9382-805d-4883-94d2-0cb07877bab7 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.608828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0c079-ba1a-4753-9797-b7e0a848b4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.609400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0c079-ba1a-4753-9797-b7e0a848b4ec admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.609680 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0c079-ba1a-4753-9797-b7e0a848b4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.609954 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0c079-ba1a-4753-9797-b7e0a848b4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.610580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0c079-ba1a-4753-9797-b7e0a848b4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.611931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1361/2759] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:31.612163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0c079-ba1a-4753-9797-b7e0a848b4ec admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.622578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1399/2760] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:31.626700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.639703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f8335-b314-4e91-b112-93ccc81545f8 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.644908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.645563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.645846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.646786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] PATH_INFO: `/v3/projects/a724dba68c4649b894a95baeaeec4732/users/0718ddbd7d0d4858ae8471de9f4111f7/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.662088 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a724dba68c4649b894a95baeaeec4732, user_id=0718ddbd7d0d4858ae8471de9f4111f7, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.664817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:31.756704 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1362/2761] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:31 2022] PUT /identity/v3/projects/a724dba68c4649b894a95baeaeec4732/users/0718ddbd7d0d4858ae8471de9f4111f7/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:31.766986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfc734-5f1d-4664-b9c1-f17ca8e9689b None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.767279 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfc734-5f1d-4664-b9c1-f17ca8e9689b None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.767560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfc734-5f1d-4664-b9c1-f17ca8e9689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.796692 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-cedfc734-5f1d-4664-b9c1-f17ca8e9689b None None] MFA Rules not processed for user `0718ddbd7d0d4858ae8471de9f4111f7`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:31.797929 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-cedfc734-5f1d-4664-b9c1-f17ca8e9689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:31.867607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1400/2762] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:31.871881 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:31.891444 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:31.934395 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e259028-6da9-4b98-ae32-45b3eb25c5ab admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:31.939097 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:31.939697 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:31.939986 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:31.940314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:31.940966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:31.943506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.031723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1363/2763] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:31 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:32.035777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfc734-5f1d-4664-b9c1-f17ca8e9689b None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.046414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfc734-5f1d-4664-b9c1-f17ca8e9689b None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.086333 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.091952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:32.103630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.104350 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.104634 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.104910 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.109995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.109995 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.148831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0509b7c8-c9fb-4676-98fc-91ae703cdad1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.153497 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.154120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.154404 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.154683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] PATH_INFO: `/v3/users/00597febcba041479e395f1a755d7ece` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.155815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00597febcba041479e395f1a755d7ece)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.157766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.174527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1401/2764] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:32 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:32.179043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.189586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7f042-ae19-4e5b-ad22-614390306bfb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.194777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.195348 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.195632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.195911 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.196582 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.198158 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.207717 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1402/2765] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:32.211617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.220925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befacff-2ff6-4057-be5b-6f75df155325 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.225442 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.226036 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.226315 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.226589 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] PATH_INFO: `/v3/projects/87bcc7efdc1d426e97379eece130a197/users/d97dc0ed045f44e1becbb557be935baf/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.240882 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bcc7efdc1d426e97379eece130a197, user_id=d97dc0ed045f44e1becbb557be935baf, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.243426 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.299378 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1403/2766] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:32 2022] PUT /identity/v3/projects/87bcc7efdc1d426e97379eece130a197/users/d97dc0ed045f44e1becbb557be935baf/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:32.303690 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.330700 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00597febcba041479e395f1a755d7ece'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:32.331515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00597febcba041479e395f1a755d7ece'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:32.332186 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00597febcba041479e395f1a755d7ece'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:32.339235 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00597febcba041479e395f1a755d7ece'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:32.364213 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81894044-e107-45a9-ae36-b17c827aa721 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.369311 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.369900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.370178 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.370451 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.371113 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.372777 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.382877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1404/2767] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:32.386966 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.388660 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:32.401012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e7665-eaa4-4e96-b92e-cbb66298efe8 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.405691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26205edc-aa1f-49c7-84db-9d34c4672e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.408263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205edc-aa1f-49c7-84db-9d34c4672e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.408263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205edc-aa1f-49c7-84db-9d34c4672e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.408263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26205edc-aa1f-49c7-84db-9d34c4672e80 admin admin] PATH_INFO: `/v3/projects/87bcc7efdc1d426e97379eece130a197/users/d97dc0ed045f44e1becbb557be935baf/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.408846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205edc-aa1f-49c7-84db-9d34c4672e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87bcc7efdc1d426e97379eece130a197, user_id=d97dc0ed045f44e1becbb557be935baf, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.411424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26205edc-aa1f-49c7-84db-9d34c4672e80 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.421730 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1405/2768] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:32 2022] PUT /identity/v3/projects/87bcc7efdc1d426e97379eece130a197/users/d97dc0ed045f44e1becbb557be935baf/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:32.432492 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-7be7681d-9074-4a57-befd-4353d6d9d783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00597febcba041479e395f1a755d7ece'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:32.433813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.434484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.434818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.453218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1364/2769] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:32 2022] DELETE /identity/v3/users/00597febcba041479e395f1a755d7ece => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:32.457950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.458498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.458988 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.467689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] MFA Rules not processed for user `d97dc0ed045f44e1becbb557be935baf`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:32.469210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:32.478828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:32.480023 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:32.500376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:32.550907 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1365/2770] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:32.559190 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.560677 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:32.565907 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1406/2771] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:32.579789 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.581206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:32.596632 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:32.630093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8e6a2-3778-46cc-9dd0-b1605244ce30 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.634320 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.634925 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.635205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.635481 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.644975 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.646496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.647187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc4c69-011f-4551-9e7f-dd87b719c5b7 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.650926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.651532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.651816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.652094 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.656997 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1366/2772] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:32.662359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.663835 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.674620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1407/2773] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:32.885721 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:32.898262 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570bc25-47f3-4fbe-bf80-9e326c86bb6a service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:32.903594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:32.903594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:32.903594 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:32.903876 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:32.905951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:32.968662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:32.970105 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:32.979642 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1367/2774] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:33.069376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:33.069376 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:33.084497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d8442-c89d-4f16-9632-54b43da5a05a service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:33.091116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:33.091758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:33.092043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:33.092353 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] PATH_INFO: `/v3/projects/6163fdeb9a7c4a86b0adb067600910cd` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:33.094267 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6163fdeb9a7c4a86b0adb067600910cd)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:33.096210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:33.276676 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6163fdeb9a7c4a86b0adb067600910cd', 'request_id': 'req-15d81046-3388-42a8-9134-c0254eaf8082'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.282691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6163fdeb9a7c4a86b0adb067600910cd', 'request_id': 'req-15d81046-3388-42a8-9134-c0254eaf8082'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.390539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6163fdeb9a7c4a86b0adb067600910cd', 'request_id': 'req-15d81046-3388-42a8-9134-c0254eaf8082'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.402988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] The token cache is being invalidate because project 6163fdeb9a7c4a86b0adb067600910cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:33.403278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.403912 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.405536 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1408/2775] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:33 2022] DELETE /identity/v3/projects/6163fdeb9a7c4a86b0adb067600910cd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:33.409695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:33.420560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7d79e-7cde-4beb-a5c6-84cd232da132 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:33.475993 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:33.476663 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:33.476947 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:33.477226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] PATH_INFO: `/v3/users/4c5dd3c99039424cae93589c0f04ce41` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:33.478351 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5dd3c99039424cae93589c0f04ce41)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:33.480292 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:33.484746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:33.775811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5dd3c99039424cae93589c0f04ce41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.776516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5dd3c99039424cae93589c0f04ce41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.777133 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5dd3c99039424cae93589c0f04ce41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.784068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5dd3c99039424cae93589c0f04ce41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.841840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-992aa601-3c0b-48c4-b6eb-f5251bdb4397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5dd3c99039424cae93589c0f04ce41'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:33.859818 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1368/2776] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:33 2022] DELETE /identity/v3/users/4c5dd3c99039424cae93589c0f04ce41 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:34.272762 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:34.274286 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:34.288623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d81046-3388-42a8-9134-c0254eaf8082 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:34.348440 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:34.349070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:34.349979 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:34.350281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] PATH_INFO: `/v3/projects/d51b10e8bec540f99f66f8a8aad9a2e2` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:34.351392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51b10e8bec540f99f66f8a8aad9a2e2)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:34.353356 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:34.476040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:34.482645 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51b10e8bec540f99f66f8a8aad9a2e2', 'request_id': 'req-6d01023b-12f3-43ca-b9c4-6e7c7a935780'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:34.488539 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51b10e8bec540f99f66f8a8aad9a2e2', 'request_id': 'req-6d01023b-12f3-43ca-b9c4-6e7c7a935780'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:34.578057 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51b10e8bec540f99f66f8a8aad9a2e2', 'request_id': 'req-6d01023b-12f3-43ca-b9c4-6e7c7a935780'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:34.588851 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] The token cache is being invalidate because project d51b10e8bec540f99f66f8a8aad9a2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:34.589142 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:34.589767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6d01023b-12f3-43ca-b9c4-6e7c7a935780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:34.591546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1409/2777] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:34 2022] DELETE /identity/v3/projects/d51b10e8bec540f99f66f8a8aad9a2e2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:34.596306 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47f63-2313-4c47-b8e4-95db1d138926 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:34.596598 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47f63-2313-4c47-b8e4-95db1d138926 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:34.596878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d47f63-2313-4c47-b8e4-95db1d138926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:34.616429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-73d47f63-2313-4c47-b8e4-95db1d138926 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:34.619179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-73d47f63-2313-4c47-b8e4-95db1d138926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:34.676440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1369/2778] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:34.683888 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52c1-5cfd-4315-968e-39cc0656a84e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:34.684176 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52c1-5cfd-4315-968e-39cc0656a84e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:34.684476 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd52c1-5cfd-4315-968e-39cc0656a84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:34.703946 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-25dd52c1-5cfd-4315-968e-39cc0656a84e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:34.705928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-25dd52c1-5cfd-4315-968e-39cc0656a84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:34.714655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1410/2779] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:34.718963 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47f63-2313-4c47-b8e4-95db1d138926 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:34.728474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d47f63-2313-4c47-b8e4-95db1d138926 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:34.732930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:34.733518 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:34.733816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:34.734072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:34.734716 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:34.735019 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:34.736646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:34.747843 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1370/2780] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:57:34.751926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd52c1-5cfd-4315-968e-39cc0656a84e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:34.761818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd52c1-5cfd-4315-968e-39cc0656a84e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:34.766533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:34.767134 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:34.767415 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:34.767691 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:34.768399 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:34.770285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:34.855560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1411/2781] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:34 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:34.859411 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:34.869615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5164b8b-28c4-4529-b165-4cd473df0795 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:34.925556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:34.926223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:34.926507 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:34.926790 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:34.927429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:34.929383 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:35.037429 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:35.042563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1371/2782] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:34 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:57:35.046633 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:35.057591 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e89ab-6cad-465b-b22e-56d265504fa4 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:35.062160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:35.062756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:35.063040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:35.063323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:35.063974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:35.070485 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:35.078586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1412/2783] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:35.082611 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:35.093498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95aac57-ee85-41da-9fbf-46e684264349 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:35.098214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f801d5-fe20-4f15-995c-857dc36b6524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:35.098813 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f801d5-fe20-4f15-995c-857dc36b6524 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:35.099100 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f801d5-fe20-4f15-995c-857dc36b6524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:35.099377 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f801d5-fe20-4f15-995c-857dc36b6524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:35.100022 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f801d5-fe20-4f15-995c-857dc36b6524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:35.101648 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f801d5-fe20-4f15-995c-857dc36b6524 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:35.112091 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1372/2784] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:35.116807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:35.126844 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc419ce-6cf9-4bda-9fce-dcfdddd4f655 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:35.132246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:35.132900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:35.133185 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:35.133465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] PATH_INFO: `/v3/projects/aab28c2a232040919f51becaa9f267de/users/39d78ae462874fd8ad3eeb4fe0b5c731/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:35.147772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab28c2a232040919f51becaa9f267de, user_id=39d78ae462874fd8ad3eeb4fe0b5c731, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:35.150507 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:35.219329 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1413/2785] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:35 2022] PUT /identity/v3/projects/aab28c2a232040919f51becaa9f267de/users/39d78ae462874fd8ad3eeb4fe0b5c731/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:35.230501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:35.230792 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:35.231072 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:35.259650 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] MFA Rules not processed for user `39d78ae462874fd8ad3eeb4fe0b5c731`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:35.260894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:35.337593 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1373/2786] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:35.348585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:35.350538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:35.411297 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1825a-2c1e-4f50-851c-e028636b5b83 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:35.415547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd5c2b-aab2-4667-8f0a-74685e6d6282 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:35.416183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c2b-aab2-4667-8f0a-74685e6d6282 service glance] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:35.416493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c2b-aab2-4667-8f0a-74685e6d6282 service glance] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:35.416773 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd5c2b-aab2-4667-8f0a-74685e6d6282 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:35.425456 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5c2b-aab2-4667-8f0a-74685e6d6282 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:35.426519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd5c2b-aab2-4667-8f0a-74685e6d6282 service glance] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:35.436017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1414/2787] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:39.411500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:39.412973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:39.483021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd4931-5a79-49a3-9264-0e1c46102fdd None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:39.487570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:39.488233 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:39.488516 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:39.488800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] PATH_INFO: `/v3/users/0718ddbd7d0d4858ae8471de9f4111f7` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:39.489917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0718ddbd7d0d4858ae8471de9f4111f7)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:39.491830 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:39.644771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0718ddbd7d0d4858ae8471de9f4111f7'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:39.645360 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0718ddbd7d0d4858ae8471de9f4111f7'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:39.645969 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0718ddbd7d0d4858ae8471de9f4111f7'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:39.652894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0718ddbd7d0d4858ae8471de9f4111f7'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:39.705431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0718ddbd7d0d4858ae8471de9f4111f7'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:39.719305 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:39.724828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1374/2788] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:39 2022] DELETE /identity/v3/users/0718ddbd7d0d4858ae8471de9f4111f7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:39.729322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:39.729838 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:39.729940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:39.748666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:39.749852 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:39.809699 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1415/2789] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:39.820368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:39.821775 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:39.881425 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e4089-2284-4965-b38d-e5d6dd8df3f7 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:39.885328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:39.885950 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:39.886231 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:39.886505 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:39.896776 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:39.898142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:39.907358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1375/2790] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:40.319150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:40.320686 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:40.333021 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce5e1c-9b84-423c-add8-5f695e1d3f9c None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:40.338876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:40.339535 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:40.339949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:40.340175 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] PATH_INFO: `/v3/projects/a724dba68c4649b894a95baeaeec4732` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:40.342732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a724dba68c4649b894a95baeaeec4732)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:40.343588 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:40.345761 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:40.448235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a724dba68c4649b894a95baeaeec4732', 'request_id': 'req-ebad3091-41b2-4a02-86fc-b4e2b5212254'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.454221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a724dba68c4649b894a95baeaeec4732', 'request_id': 'req-ebad3091-41b2-4a02-86fc-b4e2b5212254'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.527993 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a724dba68c4649b894a95baeaeec4732', 'request_id': 'req-ebad3091-41b2-4a02-86fc-b4e2b5212254'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.544080 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] The token cache is being invalidate because project a724dba68c4649b894a95baeaeec4732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:40.544519 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.545180 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.546729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1416/2791] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:40 2022] DELETE /identity/v3/projects/a724dba68c4649b894a95baeaeec4732 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:40.550735 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:40.564171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896b1d-5a13-453d-9558-0678a0ba79c7 service neutron] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:40.618647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:40.619280 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:40.619566 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:40.619849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] PATH_INFO: `/v3/users/d97dc0ed045f44e1becbb557be935baf` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:40.621309 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97dc0ed045f44e1becbb557be935baf)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:40.623686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:40.783647 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97dc0ed045f44e1becbb557be935baf'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.784277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97dc0ed045f44e1becbb557be935baf'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.784905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97dc0ed045f44e1becbb557be935baf'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.791816 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97dc0ed045f44e1becbb557be935baf'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.869941 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-19770c59-e1e8-47dd-8d64-13c0b0c61d79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97dc0ed045f44e1becbb557be935baf'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:40.888148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1376/2792] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:40 2022] DELETE /identity/v3/users/d97dc0ed045f44e1becbb557be935baf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:41.301139 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:41.303028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:41.316533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad3091-41b2-4a02-86fc-b4e2b5212254 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:41.377151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:41.377976 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:41.378263 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:41.378544 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] PATH_INFO: `/v3/projects/87bcc7efdc1d426e97379eece130a197` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:41.379800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87bcc7efdc1d426e97379eece130a197)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:41.382568 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:41.506719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87bcc7efdc1d426e97379eece130a197', 'request_id': 'req-3042a7aa-0a0e-49d4-a313-a59cb85c1533'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:41.512829 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87bcc7efdc1d426e97379eece130a197', 'request_id': 'req-3042a7aa-0a0e-49d4-a313-a59cb85c1533'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:41.556892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87bcc7efdc1d426e97379eece130a197', 'request_id': 'req-3042a7aa-0a0e-49d4-a313-a59cb85c1533'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:41.567613 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] The token cache is being invalidate because project 87bcc7efdc1d426e97379eece130a197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:41.573188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:41.573188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-3042a7aa-0a0e-49d4-a313-a59cb85c1533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:41.573188 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1417/2793] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:41 2022] DELETE /identity/v3/projects/87bcc7efdc1d426e97379eece130a197 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:41.576122 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae037b-3bba-47ac-90aa-2365a503bdb6 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:41.576646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae037b-3bba-47ac-90aa-2365a503bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:41.576771 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae037b-3bba-47ac-90aa-2365a503bdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:41.599797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6fae037b-3bba-47ac-90aa-2365a503bdb6 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:41.600923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6fae037b-3bba-47ac-90aa-2365a503bdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:41.614781 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:41.661643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1377/2794] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:41.669310 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c9e6-a881-4dc2-bca3-b9a71eabbea7 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:41.669598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c9e6-a881-4dc2-bca3-b9a71eabbea7 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:41.669873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c9e6-a881-4dc2-bca3-b9a71eabbea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:41.689918 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ec19c9e6-a881-4dc2-bca3-b9a71eabbea7 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:41.691121 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ec19c9e6-a881-4dc2-bca3-b9a71eabbea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:41.699491 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1418/2795] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:41.703759 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae037b-3bba-47ac-90aa-2365a503bdb6 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:41.713967 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae037b-3bba-47ac-90aa-2365a503bdb6 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:41.719530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:41.720434 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:41.720720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:41.721095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:41.722004 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:41.722548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:41.724761 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:41.736810 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1378/2796] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:57:41.741072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c9e6-a881-4dc2-bca3-b9a71eabbea7 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:41.750152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c9e6-a881-4dc2-bca3-b9a71eabbea7 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:41.754767 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:41.755872 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:41.756154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:41.756483 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:41.757112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:41.758986 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:41.770764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:41.844630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1419/2797] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:41 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:41.850324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:41.861141 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e48c3-83e6-4299-b123-5cd592f2b46f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:41.921515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:41.922151 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:41.922435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:41.922715 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:41.923352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:41.925323 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:42.014017 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1379/2798] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:41 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:42.018198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:42.028743 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16810426-bef3-46df-a6bc-2a305e2eff66 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:42.034209 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:42.034886 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.035201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.035471 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.036274 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:42.038162 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:42.048617 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1420/2799] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:42.053606 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:42.064030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbacf9d-3b02-4c24-a988-9ac4660c02ae admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:42.069419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec1b13-2a9c-4bfb-9cd6-e9d6158c7e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:42.070014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1b13-2a9c-4bfb-9cd6-e9d6158c7e24 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.070295 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1b13-2a9c-4bfb-9cd6-e9d6158c7e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.070620 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec1b13-2a9c-4bfb-9cd6-e9d6158c7e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.071285 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec1b13-2a9c-4bfb-9cd6-e9d6158c7e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:42.072900 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec1b13-2a9c-4bfb-9cd6-e9d6158c7e24 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:42.083388 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1380/2800] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:42.088169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:42.098765 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0d476-2bab-4e41-a3a2-2e890938bceb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:42.103943 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:42.104620 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.104900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.105177 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] PATH_INFO: `/v3/projects/b14d3c38fb784fe69e4c3ac5f83a98da/users/76c385d6e9bb4ad3a7e1a36ad0c71c38/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.120174 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14d3c38fb784fe69e4c3ac5f83a98da, user_id=76c385d6e9bb4ad3a7e1a36ad0c71c38, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:42.122815 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:42.196616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1421/2801] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:42 2022] PUT /identity/v3/projects/b14d3c38fb784fe69e4c3ac5f83a98da/users/76c385d6e9bb4ad3a7e1a36ad0c71c38/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:42.208033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f838-43fb-4c78-b446-b06f314bcadf None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.208368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f838-43fb-4c78-b446-b06f314bcadf None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.228045 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01f838-43fb-4c78-b446-b06f314bcadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.237506 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-fa01f838-43fb-4c78-b446-b06f314bcadf None None] MFA Rules not processed for user `76c385d6e9bb4ad3a7e1a36ad0c71c38`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:42.238723 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-fa01f838-43fb-4c78-b446-b06f314bcadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:42.307817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1381/2802] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:42.318963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:42.320782 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:42.378000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4b10e-18b7-4654-bf13-4f96a7a4d153 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:42.381618 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b7734-cd61-44c3-b9a6-b8901d5ee97c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:42.382222 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b7734-cd61-44c3-b9a6-b8901d5ee97c service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.382501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b7734-cd61-44c3-b9a6-b8901d5ee97c service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.405512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b7734-cd61-44c3-b9a6-b8901d5ee97c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.405512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b7734-cd61-44c3-b9a6-b8901d5ee97c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:42.405512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b7734-cd61-44c3-b9a6-b8901d5ee97c service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:42.405512 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1422/2803] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:42.422896 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f838-43fb-4c78-b446-b06f314bcadf None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:42.440090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:42.485503 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01f838-43fb-4c78-b446-b06f314bcadf None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:42.491282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:42.492009 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.492326 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.492689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] PATH_INFO: `/v3/users/76c385d6e9bb4ad3a7e1a36ad0c71c38` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.494036 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c385d6e9bb4ad3a7e1a36ad0c71c38)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:42.496011 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:42.670779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c385d6e9bb4ad3a7e1a36ad0c71c38'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:42.670779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c385d6e9bb4ad3a7e1a36ad0c71c38'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:42.670779 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c385d6e9bb4ad3a7e1a36ad0c71c38'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:42.675786 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c385d6e9bb4ad3a7e1a36ad0c71c38'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:42.745244 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c385d6e9bb4ad3a7e1a36ad0c71c38'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:42.764435 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1382/2804] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:42 2022] DELETE /identity/v3/users/76c385d6e9bb4ad3a7e1a36ad0c71c38 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:42.769091 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.769382 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.769663 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.788020 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:42.789244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:42.846184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1423/2805] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:42.856801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:42.858250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:42.918145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eff4f-5a8e-4b7b-b1eb-9041a420440d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:42.921939 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceac0fd-6d2d-4219-9a81-49ccd5be11f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:42.922549 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac0fd-6d2d-4219-9a81-49ccd5be11f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:42.922832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac0fd-6d2d-4219-9a81-49ccd5be11f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:42.923102 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceac0fd-6d2d-4219-9a81-49ccd5be11f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:42.932702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceac0fd-6d2d-4219-9a81-49ccd5be11f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:42.934198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceac0fd-6d2d-4219-9a81-49ccd5be11f9 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:42.944249 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1383/2806] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:43.347807 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:43.350150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:43.362778 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02964cc1-4360-47a4-936d-d4d41c8d93c2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:43.367974 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:43.368636 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:43.369039 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:43.369240 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] PATH_INFO: `/v3/projects/b14d3c38fb784fe69e4c3ac5f83a98da` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:43.370366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14d3c38fb784fe69e4c3ac5f83a98da)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:43.372312 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:43.466283 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14d3c38fb784fe69e4c3ac5f83a98da', 'request_id': 'req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:43.472895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14d3c38fb784fe69e4c3ac5f83a98da', 'request_id': 'req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:43.475501 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:43.556320 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14d3c38fb784fe69e4c3ac5f83a98da', 'request_id': 'req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:43.567538 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] The token cache is being invalidate because project b14d3c38fb784fe69e4c3ac5f83a98da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:43.567833 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:43.568585 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-eee23fae-587a-40c0-a3f6-df1a3d6e19f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:43.570072 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1424/2807] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:43 2022] DELETE /identity/v3/projects/b14d3c38fb784fe69e4c3ac5f83a98da => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:43.574894 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60489-48e6-4eee-8e56-cca8a1162b25 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:43.575185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60489-48e6-4eee-8e56-cca8a1162b25 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:43.579741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f60489-48e6-4eee-8e56-cca8a1162b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:43.595984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-53f60489-48e6-4eee-8e56-cca8a1162b25 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:43.597346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-53f60489-48e6-4eee-8e56-cca8a1162b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:43.630046 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:43.657276 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1384/2808] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:43.665038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71799d-c8f5-4d0b-b156-0ca61b94e3d2 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:43.665349 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71799d-c8f5-4d0b-b156-0ca61b94e3d2 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:43.665623 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71799d-c8f5-4d0b-b156-0ca61b94e3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:43.687298 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-1d71799d-c8f5-4d0b-b156-0ca61b94e3d2 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:43.688790 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-1d71799d-c8f5-4d0b-b156-0ca61b94e3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:43.697400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1425/2809] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:43.701590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60489-48e6-4eee-8e56-cca8a1162b25 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:43.711821 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f60489-48e6-4eee-8e56-cca8a1162b25 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:43.716955 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:43.717498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:43.717780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:43.718055 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:43.718703 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:43.719010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:43.720917 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:43.733557 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1385/2810] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:43.738212 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71799d-c8f5-4d0b-b156-0ca61b94e3d2 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:43.747499 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71799d-c8f5-4d0b-b156-0ca61b94e3d2 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:43.752179 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:43.752805 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:43.753087 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:43.753363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:43.753996 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:43.756458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:43.890123 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1426/2811] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:43 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:43.894077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:43.905207 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172193d2-a5b9-48bc-a230-0fc4358f133e admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:43.962168 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:43.962783 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:43.963069 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:43.963349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:43.963978 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:43.966198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.036335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1386/2812] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:43 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:44.040152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.050423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7cc3d-67b8-41e6-9d76-b56c6306b970 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.055546 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.056133 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.056452 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.056734 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.057400 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.058988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.070839 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1427/2813] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:44.074682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.085077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4189299-11de-4f98-a9b2-262b5bb021c1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.089758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7f2ad-d209-4f03-a71a-e2e89ed43679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.090363 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f2ad-d209-4f03-a71a-e2e89ed43679 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.090639 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f2ad-d209-4f03-a71a-e2e89ed43679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.091176 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f2ad-d209-4f03-a71a-e2e89ed43679 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.091825 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7f2ad-d209-4f03-a71a-e2e89ed43679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.093454 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7f2ad-d209-4f03-a71a-e2e89ed43679 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.104147 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1387/2814] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:44.108570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.119201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9a3d5-99ab-4bf0-adbf-7bbbb1e9b913 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.123780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.124527 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.124846 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.125127 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] PATH_INFO: `/v3/projects/025c2e80ece64a35a8ee9432e470d9b8/users/de8beab45e0546dc932dd1288a4cbfb6/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.139889 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=025c2e80ece64a35a8ee9432e470d9b8, user_id=de8beab45e0546dc932dd1288a4cbfb6, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.142780 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.203252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1428/2815] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:44 2022] PUT /identity/v3/projects/025c2e80ece64a35a8ee9432e470d9b8/users/de8beab45e0546dc932dd1288a4cbfb6/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:44.213635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c6a4-1c31-49bf-b3b5-9f8022030b70 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.213926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c6a4-1c31-49bf-b3b5-9f8022030b70 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.214206 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966c6a4-1c31-49bf-b3b5-9f8022030b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.242726 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-3966c6a4-1c31-49bf-b3b5-9f8022030b70 None None] MFA Rules not processed for user `de8beab45e0546dc932dd1288a4cbfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:44.243962 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-3966c6a4-1c31-49bf-b3b5-9f8022030b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:44.309602 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1388/2816] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:44.314084 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.375746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98cdd-c03a-4d97-9584-32f642bdbf06 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.380443 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.381661 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.381945 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.382243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.382878 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.384806 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.444081 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1429/2817] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:44 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:44.448757 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966c6a4-1c31-49bf-b3b5-9f8022030b70 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.461315 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966c6a4-1c31-49bf-b3b5-9f8022030b70 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.495192 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:44.522209 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.522819 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.523099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.523474 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.524118 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.526104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.600535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1389/2818] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:44 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:44.601843 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.614264 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c826b-0100-4e1d-a54b-d5084cdef849 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.619940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.620583 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.620873 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.624803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.624803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.624803 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.634393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1430/2819] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:44.638634 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.649758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a934e544-35be-46de-811b-b3ed829a9951 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.654090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925443-ef69-4ae2-850c-9f011ebbd4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.654707 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925443-ef69-4ae2-850c-9f011ebbd4cd admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.654995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925443-ef69-4ae2-850c-9f011ebbd4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.655272 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925443-ef69-4ae2-850c-9f011ebbd4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.655926 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925443-ef69-4ae2-850c-9f011ebbd4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.657564 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e925443-ef69-4ae2-850c-9f011ebbd4cd admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.668968 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1390/2820] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:44.673135 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.684169 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd5568-199b-4ce9-a526-bfaf14daf7df admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.689070 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.689732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.690022 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.690334 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] PATH_INFO: `/v3/projects/cfbed8f49d3b4e249b41eeb5ec0e54ea/users/6a7a4f3dc87a444f8b718dbbcce48047/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.706925 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbed8f49d3b4e249b41eeb5ec0e54ea, user_id=6a7a4f3dc87a444f8b718dbbcce48047, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.709709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:44.790554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1431/2821] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:44 2022] PUT /identity/v3/projects/cfbed8f49d3b4e249b41eeb5ec0e54ea/users/6a7a4f3dc87a444f8b718dbbcce48047/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:44.798587 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b5f2-9d63-4990-8310-000ad694df0a None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.802562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b5f2-9d63-4990-8310-000ad694df0a None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.802562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6b5f2-9d63-4990-8310-000ad694df0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.827337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-71a6b5f2-9d63-4990-8310-000ad694df0a None None] MFA Rules not processed for user `6a7a4f3dc87a444f8b718dbbcce48047`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:44.828846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-71a6b5f2-9d63-4990-8310-000ad694df0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:44.899164 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1391/2822] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:44.903733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:44.935112 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:44.973895 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e569c-8f7b-40b0-8ed3-d61722932485 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:44.979557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:44.980221 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:44.980545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:44.980894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:44.981552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:44.983511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.061165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1432/2823] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:44 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:45.065386 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6b5f2-9d63-4990-8310-000ad694df0a None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:45.077349 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6b5f2-9d63-4990-8310-000ad694df0a None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:45.139667 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:45.140373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.140660 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.140942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.141592 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:45.143533 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.203532 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1392/2824] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:45 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:45.207423 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:45.218897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67befd7b-1f79-4cd9-a6f0-8bd161921b9c admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:45.223555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:45.224234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.224523 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.224802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.225455 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:45.227470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.244511 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1433/2825] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:45.245720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:45.256437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd244-849e-48e8-9649-3d604ccd6f31 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:45.260990 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:45.261635 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.261918 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.262198 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] PATH_INFO: `/v3/projects/f44dfdf27c2d4c06a9ca57385233a048/users/bcd541418e544ceeb1536df15a8d7a76/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.279225 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44dfdf27c2d4c06a9ca57385233a048, user_id=bcd541418e544ceeb1536df15a8d7a76, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:45.282034 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.340674 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1393/2826] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:45 2022] PUT /identity/v3/projects/f44dfdf27c2d4c06a9ca57385233a048/users/bcd541418e544ceeb1536df15a8d7a76/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:45.345732 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:45.356866 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b0a33-725a-459a-8fe4-5f57ea4565f4 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:45.401099 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:45.403030 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:45.424826 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:45.439003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:45.439450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.439560 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.439840 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.440616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:45.442252 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.459363 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1434/2827] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:45.459763 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:45.470705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c22ab-0e7a-4790-8182-5d2dfd8d6534 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:45.477580 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f519738-448e-4f18-a90b-c45e283f5cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:45.478254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519738-448e-4f18-a90b-c45e283f5cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.478541 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519738-448e-4f18-a90b-c45e283f5cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.478825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f519738-448e-4f18-a90b-c45e283f5cf6 admin admin] PATH_INFO: `/v3/projects/f44dfdf27c2d4c06a9ca57385233a048/users/bcd541418e544ceeb1536df15a8d7a76/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.480926 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f519738-448e-4f18-a90b-c45e283f5cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44dfdf27c2d4c06a9ca57385233a048, user_id=bcd541418e544ceeb1536df15a8d7a76, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:45.483710 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f519738-448e-4f18-a90b-c45e283f5cf6 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.502572 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1435/2828] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:45 2022] PUT /identity/v3/projects/f44dfdf27c2d4c06a9ca57385233a048/users/bcd541418e544ceeb1536df15a8d7a76/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:57:45.513152 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.513505 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.513795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.535345 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762b8cc-231f-4ca4-9d47-61478dd109b5 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:45.546151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] MFA Rules not processed for user `bcd541418e544ceeb1536df15a8d7a76`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:45.547655 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:45.617794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '344aa2356f0c4d8fb88e7c35603a65c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:45.618515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.618799 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.619083 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.621603 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:45.635328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:45.638963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1436/2829] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:57:45.639095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.648586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:45.650395 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:45.657708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1394/2830] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:45.681466 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:45.734275 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d126415d-8300-42f3-91a0-9d8f909065a9 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:45.738290 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:45.739160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:45.739494 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:45.740404 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:45.816419 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:45.818899 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:45.849015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1437/2831] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:47.748127 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:47.759780 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452f101-f012-4fb4-9460-e88ca8e6fe14 service nova] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:47.763805 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:47.764524 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:47.764841 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:47.765095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:47.825514 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:47.826973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:47.836957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1395/2832] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:57:49.362940 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:49.372814 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35df1b8-e5b1-45ea-875e-b28bc04f28c0 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:49.376493 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:49.377095 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:49.377403 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:49.377747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:49.387900 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:49.389528 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:49.399115 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1438/2833] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:50.829983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:50.831413 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:50.862666 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:50.887951 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd28b7-a1b7-408a-8daf-4ad2d4c7d59a service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:50.891473 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5c9e7-f16d-4653-befa-cf9031153286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:50.892108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c9e7-f16d-4653-befa-cf9031153286 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:50.892415 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c9e7-f16d-4653-befa-cf9031153286 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:50.892702 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5c9e7-f16d-4653-befa-cf9031153286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:50.894431 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-e1d5c9e7-f16d-4653-befa-cf9031153286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:50.955691 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c9e7-f16d-4653-befa-cf9031153286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:50.957199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d5c9e7-f16d-4653-befa-cf9031153286 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:50.967076 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1396/2834] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:51.676488 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:51.678025 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:51.691770 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cfa29-d504-4c85-88c2-f81118078b74 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:51.696414 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:51.697048 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:51.697326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:51.697598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] PATH_INFO: `/v3/users/39d78ae462874fd8ad3eeb4fe0b5c731` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:51.698816 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d78ae462874fd8ad3eeb4fe0b5c731)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:51.700756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:51.892272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d78ae462874fd8ad3eeb4fe0b5c731'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:51.892970 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d78ae462874fd8ad3eeb4fe0b5c731'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:51.893594 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d78ae462874fd8ad3eeb4fe0b5c731'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:51.909646 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d78ae462874fd8ad3eeb4fe0b5c731'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:51.979948 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d78ae462874fd8ad3eeb4fe0b5c731'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:51.997458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1439/2835] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:51 2022] DELETE /identity/v3/users/39d78ae462874fd8ad3eeb4fe0b5c731 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:52.001797 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:52.002316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:52.002479 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:52.026090 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:52.028000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:52.092970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1397/2836] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:52.102788 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:52.104251 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:52.132562 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:52.163497 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b871d36-bdee-4c76-966d-017a99ceacf3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:52.167433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953709d-cd73-49c3-9c2d-29f4ae0c836d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:52.168037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953709d-cd73-49c3-9c2d-29f4ae0c836d service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:52.168470 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953709d-cd73-49c3-9c2d-29f4ae0c836d service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:52.168752 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953709d-cd73-49c3-9c2d-29f4ae0c836d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:52.178073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953709d-cd73-49c3-9c2d-29f4ae0c836d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:52.179571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953709d-cd73-49c3-9c2d-29f4ae0c836d service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:52.189820 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1440/2837] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:52.615866 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:52.618082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:52.633392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec08ef-f0aa-4605-bd02-4938cdaeab56 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:52.647696 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:52.648692 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:52.649430 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:52.650152 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] PATH_INFO: `/v3/projects/aab28c2a232040919f51becaa9f267de` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:52.651995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab28c2a232040919f51becaa9f267de)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:52.654338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:52.778044 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab28c2a232040919f51becaa9f267de', 'request_id': 'req-9f651025-9858-4204-9e62-93d5995ae35f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:52.784766 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab28c2a232040919f51becaa9f267de', 'request_id': 'req-9f651025-9858-4204-9e62-93d5995ae35f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:52.791218 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab28c2a232040919f51becaa9f267de', 'request_id': 'req-9f651025-9858-4204-9e62-93d5995ae35f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:52.855234 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] The token cache is being invalidate because project aab28c2a232040919f51becaa9f267de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:52.855931 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:52.856719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-9f651025-9858-4204-9e62-93d5995ae35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:52.858457 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1398/2838] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:52 2022] DELETE /identity/v3/projects/aab28c2a232040919f51becaa9f267de => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:52.865245 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad933e-b23b-47e0-a29b-386fcf6f5a19 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:52.865746 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad933e-b23b-47e0-a29b-386fcf6f5a19 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:52.865848 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad933e-b23b-47e0-a29b-386fcf6f5a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:52.885384 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-f9ad933e-b23b-47e0-a29b-386fcf6f5a19 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:52.886599 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-f9ad933e-b23b-47e0-a29b-386fcf6f5a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:52.952573 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1441/2839] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:52.968483 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194001e-f484-4763-a7ff-c1c0c2b61487 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:52.968977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194001e-f484-4763-a7ff-c1c0c2b61487 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:52.969270 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194001e-f484-4763-a7ff-c1c0c2b61487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:52.979617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:53.001421 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0194001e-f484-4763-a7ff-c1c0c2b61487 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:53.002689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0194001e-f484-4763-a7ff-c1c0c2b61487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:53.012984 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1399/2840] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:53.017824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad933e-b23b-47e0-a29b-386fcf6f5a19 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:53.031150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad933e-b23b-47e0-a29b-386fcf6f5a19 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:53.036735 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:53.037999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.038380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.038728 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.040759 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:53.041181 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:53.043867 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:53.059612 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1442/2841] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:53.064418 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194001e-f484-4763-a7ff-c1c0c2b61487 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:53.074381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194001e-f484-4763-a7ff-c1c0c2b61487 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:53.080869 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:53.081567 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.081930 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.082282 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.083161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:53.086911 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:53.197494 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1400/2842] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:53 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:53.205380 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:53.217984 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9c702-7ea7-4b53-bf13-d028e17c90b2 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:53.278250 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:53.279333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.279796 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.280288 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.280991 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:53.282922 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:53.368167 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1443/2843] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:53 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:53.372166 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:53.382248 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0e5725-b19d-49e7-b607-3ba82fd9c0a1 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:53.387392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:53.388010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.388327 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.388608 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.389278 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:53.391162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:53.402253 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1401/2844] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:53.406345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:53.417131 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18853a32-f774-4471-8c1e-2126c203bec3 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:53.422747 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215ad5a-bd8f-414d-ab1c-5c153896039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:53.424704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ad5a-bd8f-414d-ab1c-5c153896039d admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.424704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ad5a-bd8f-414d-ab1c-5c153896039d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.424704 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215ad5a-bd8f-414d-ab1c-5c153896039d admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.425750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215ad5a-bd8f-414d-ab1c-5c153896039d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:53.427155 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215ad5a-bd8f-414d-ab1c-5c153896039d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:53.438914 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1444/2845] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:57:53.443316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:53.454095 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea7ff6-e0cf-4002-ae0d-198e7b4c0b5d admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:53.459574 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:53.460260 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.460548 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.461523 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] PATH_INFO: `/v3/projects/094591e096674a7cb778642219d766ad/users/fcd3a153a847477fb9e0759607ffbf7e/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.477924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094591e096674a7cb778642219d766ad, user_id=fcd3a153a847477fb9e0759607ffbf7e, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:53.480656 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:53.552631 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1402/2846] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:53 2022] PUT /identity/v3/projects/094591e096674a7cb778642219d766ad/users/fcd3a153a847477fb9e0759607ffbf7e/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:53.557681 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.558000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.558277 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.591067 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:53.592581 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:53.634952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:53.673949 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1445/2847] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:53.685838 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:53.692614 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:53.749242 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe9a9a-e3d2-47cc-9be3-6cdcb6213b46 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:53.753120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db798d3e-e88c-4381-bad3-f66c4ebd3964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:53.753765 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798d3e-e88c-4381-bad3-f66c4ebd3964 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:53.754161 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798d3e-e88c-4381-bad3-f66c4ebd3964 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:53.754487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db798d3e-e88c-4381-bad3-f66c4ebd3964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:53.764877 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db798d3e-e88c-4381-bad3-f66c4ebd3964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:53.766322 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db798d3e-e88c-4381-bad3-f66c4ebd3964 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:53.776379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1403/2848] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:54.082824 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:54.084427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:54.096729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ac276-a54b-41fb-bdde-8cfead58c44c None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:54.101909 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:54.102547 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:54.102827 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:54.103099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] PATH_INFO: `/v3/users/de8beab45e0546dc932dd1288a4cbfb6` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:54.104270 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de8beab45e0546dc932dd1288a4cbfb6)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:54.106285 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:54.275328 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de8beab45e0546dc932dd1288a4cbfb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:54.276450 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de8beab45e0546dc932dd1288a4cbfb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:54.278227 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de8beab45e0546dc932dd1288a4cbfb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:54.311800 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de8beab45e0546dc932dd1288a4cbfb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:54.421718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de8beab45e0546dc932dd1288a4cbfb6'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:54.445199 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1446/2849] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:54 2022] DELETE /identity/v3/users/de8beab45e0546dc932dd1288a4cbfb6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:54.449490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:54.449966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:54.450064 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:54.474817 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:54.478619 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:54.551021 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1404/2850] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:54.563424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:54.567393 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:54.646530 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562eb7a3-3e5e-46ca-9453-9aa5294fcb4b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:54.651017 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:54.651638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:54.651923 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:54.652219 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:54.667637 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:54.669191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:54.680163 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1447/2851] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:57:55.244597 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:55.246475 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:55.260274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e21159-2941-4d71-85aa-3d886f85cd70 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:55.265390 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:55.266110 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:55.266443 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:55.266720 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] PATH_INFO: `/v3/projects/025c2e80ece64a35a8ee9432e470d9b8` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:55.267834 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=025c2e80ece64a35a8ee9432e470d9b8)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:55.269832 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:55.386177 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:55.397513 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '025c2e80ece64a35a8ee9432e470d9b8', 'request_id': 'req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.404521 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '025c2e80ece64a35a8ee9432e470d9b8', 'request_id': 'req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.410617 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '025c2e80ece64a35a8ee9432e470d9b8', 'request_id': 'req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.468545 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] The token cache is being invalidate because project 025c2e80ece64a35a8ee9432e470d9b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:55.469093 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.469751 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.476924 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:55.483755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1405/2852] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:55 2022] DELETE /identity/v3/projects/025c2e80ece64a35a8ee9432e470d9b8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:55.489892 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d1781-7a9e-4a27-92f5-7355675b81c2 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:55.561556 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:55.632309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:55.632309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:55.632309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:55.632309 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] PATH_INFO: `/v3/users/6a7a4f3dc87a444f8b718dbbcce48047` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:55.633191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7a4f3dc87a444f8b718dbbcce48047)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:55.633191 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:55.959271 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7a4f3dc87a444f8b718dbbcce48047'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.960073 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7a4f3dc87a444f8b718dbbcce48047'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.961375 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7a4f3dc87a444f8b718dbbcce48047'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:55.978198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7a4f3dc87a444f8b718dbbcce48047'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:56.059551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7a4f3dc87a444f8b718dbbcce48047'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:56.085302 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1448/2853] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:55 2022] DELETE /identity/v3/users/6a7a4f3dc87a444f8b718dbbcce48047 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:56.798755 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:56.800373 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:56.814713 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56fe02c-6362-47ac-b09a-6eb3dc1ff943 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:56.891500 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:56.892384 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:56.892774 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:56.893157 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] PATH_INFO: `/v3/projects/cfbed8f49d3b4e249b41eeb5ec0e54ea` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:56.894489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfbed8f49d3b4e249b41eeb5ec0e54ea)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:56.897199 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:57.031928 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfbed8f49d3b4e249b41eeb5ec0e54ea', 'request_id': 'req-1f1c98b4-0464-4922-9682-7b23a87e4549'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.040150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfbed8f49d3b4e249b41eeb5ec0e54ea', 'request_id': 'req-1f1c98b4-0464-4922-9682-7b23a87e4549'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.049084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfbed8f49d3b4e249b41eeb5ec0e54ea', 'request_id': 'req-1f1c98b4-0464-4922-9682-7b23a87e4549'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.165028 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] The token cache is being invalidate because project cfbed8f49d3b4e249b41eeb5ec0e54ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:57.165334 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.168236 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.171410 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1406/2854] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:56 2022] DELETE /identity/v3/projects/cfbed8f49d3b4e249b41eeb5ec0e54ea => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:57.175278 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:57.177705 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:57.195215 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4249d35-ecfe-474a-a21d-fd092fa58839 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:57.273733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:57.274598 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:57.275280 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:57.275648 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] PATH_INFO: `/v3/users/bcd541418e544ceeb1536df15a8d7a76` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:57.277086 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd541418e544ceeb1536df15a8d7a76)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:57.279821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:57.502150 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd541418e544ceeb1536df15a8d7a76'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.504666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd541418e544ceeb1536df15a8d7a76'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.505492 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd541418e544ceeb1536df15a8d7a76'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.521813 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd541418e544ceeb1536df15a8d7a76'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.527038 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:57.603750 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-2074e01e-6538-49d3-ae93-255525648cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd541418e544ceeb1536df15a8d7a76'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:57.624210 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1449/2855] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:57:57 2022] DELETE /identity/v3/users/bcd541418e544ceeb1536df15a8d7a76 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:58.096020 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:58.097542 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:58.118981 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c98b4-0464-4922-9682-7b23a87e4549 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:58.192289 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:58.200007 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:58.200752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:58.201092 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:58.201368 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] PATH_INFO: `/v3/projects/f44dfdf27c2d4c06a9ca57385233a048` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:58.202520 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44dfdf27c2d4c06a9ca57385233a048)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:58.204613 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:58.318502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44dfdf27c2d4c06a9ca57385233a048', 'request_id': 'req-aa2a28e6-9b77-4404-9038-787b83c4aa76'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:58.325185 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44dfdf27c2d4c06a9ca57385233a048', 'request_id': 'req-aa2a28e6-9b77-4404-9038-787b83c4aa76'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:58.331465 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44dfdf27c2d4c06a9ca57385233a048', 'request_id': 'req-aa2a28e6-9b77-4404-9038-787b83c4aa76'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:58.396419 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] The token cache is being invalidate because project f44dfdf27c2d4c06a9ca57385233a048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:57:58.396801 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:58.397337 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-aa2a28e6-9b77-4404-9038-787b83c4aa76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:57:58.399456 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1407/2856] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:57:58 2022] DELETE /identity/v3/projects/f44dfdf27c2d4c06a9ca57385233a048 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:58.404902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622c566-cb1e-4143-a256-6065b1715aa8 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:58.404902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622c566-cb1e-4143-a256-6065b1715aa8 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:58.404902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622c566-cb1e-4143-a256-6065b1715aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:58.424254 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-8622c566-cb1e-4143-a256-6065b1715aa8 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:58.425461 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-8622c566-cb1e-4143-a256-6065b1715aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:58.485276 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1450/2857] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:58.494943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229b17-231f-4b61-a0b1-af40468f8b47 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:58.495238 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229b17-231f-4b61-a0b1-af40468f8b47 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:58.495747 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229b17-231f-4b61-a0b1-af40468f8b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:58.520255 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0a229b17-231f-4b61-a0b1-af40468f8b47 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:58.521563 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0a229b17-231f-4b61-a0b1-af40468f8b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:58.534246 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1408/2858] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:58.535619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622c566-cb1e-4143-a256-6065b1715aa8 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:58.549386 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622c566-cb1e-4143-a256-6065b1715aa8 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:58.554206 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:58.555008 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:58.555321 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:58.555601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:58.556304 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82145) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:57:58.557083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:58.558238 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:58.576165 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1451/2859] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 22 05:57:58.578466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a229b17-231f-4b61-a0b1-af40468f8b47 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:58.588610 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a229b17-231f-4b61-a0b1-af40468f8b47 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:58.593651 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:58.594316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:58.594662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:58.594943 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] PATH_INFO: `/v3/projects` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:58.596049 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:58.598000 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:58.661952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1409/2860] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:57:58 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:58.666005 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:58.680818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f0192-fd00-41a0-9afc-4dd907fd60a8 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:58.798508 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:58.799429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:58.800015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:58.807208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:58.807208 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:58.810561 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:58.929427 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1452/2861] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:57:58 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:57:58.933525 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:58.944927 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3bba8-3853-4e77-8ccb-fb76d87febfa admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:58.951714 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:58.952399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:58.952815 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:58.952974 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:58.953878 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:58.955273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:58.969689 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1410/2862] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:58.973586 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:58.987997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06999adb-91dd-4eee-98ef-5f538109da3d admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:59.021243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7d12d-2f7c-49a4-af71-ab2edf0b7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:59.023143 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d12d-2f7c-49a4-af71-ab2edf0b7a96 admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:59.023449 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d12d-2f7c-49a4-af71-ab2edf0b7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:59.023739 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7d12d-2f7c-49a4-af71-ab2edf0b7a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:59.024441 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d12d-2f7c-49a4-af71-ab2edf0b7a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:59.026597 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7d12d-2f7c-49a4-af71-ab2edf0b7a96 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:59.057359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1453/2863] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:57:59.061409 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:59.075356 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b0ab-5d68-40b8-b942-6b8ac3a2192f admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:59.088256 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:59.088942 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:59.089227 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:59.089502 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] PATH_INFO: `/v3/projects/1442c5f9adaf4d6e8ad06edf1ce16206/users/302acf9383244eafb4df14c3c842ab3d/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:59.123682 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1442c5f9adaf4d6e8ad06edf1ce16206, user_id=302acf9383244eafb4df14c3c842ab3d, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:59.126279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:59.207014 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1411/2864] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:57:59 2022] PUT /identity/v3/projects/1442c5f9adaf4d6e8ad06edf1ce16206/users/302acf9383244eafb4df14c3c842ab3d/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:57:59.286232 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:59.287323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:59.287783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:59.333781 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] MFA Rules not processed for user `302acf9383244eafb4df14c3c842ab3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:57:59.335009 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:59.402146 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:57:59.435533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1454/2865] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:57:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:57:59.443171 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:57:59.445570 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:57:59.574800 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b136a-fa82-4bfe-9a0a-64061ac78719 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:57:59.579845 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:57:59.580746 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:57:59.581358 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:57:59.581861 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:57:59.594498 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:57:59.599314 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:57:59.621437 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1412/2866] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:57:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:58:00.053246 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:00.056428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:00.175233 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0353d-aa3d-435b-848a-1e64d386a1ae None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:00.182593 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:00.183428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:00.183817 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:00.185201 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] PATH_INFO: `/v3/users/310d7421cd114072b3f470e27c69d6bb` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:00.189337 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=310d7421cd114072b3f470e27c69d6bb)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:00.192714 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:00.447904 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310d7421cd114072b3f470e27c69d6bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:00.449977 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310d7421cd114072b3f470e27c69d6bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:00.450630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310d7421cd114072b3f470e27c69d6bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:00.483709 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310d7421cd114072b3f470e27c69d6bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:00.578630 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-fc34151a-85d6-4d38-bf2c-4ff0ee91ec5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310d7421cd114072b3f470e27c69d6bb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:00.592845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1455/2867] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:58:00 2022] DELETE /identity/v3/users/310d7421cd114072b3f470e27c69d6bb => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:58:00.867750 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:00.880662 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b121f-6fc0-49e0-a73c-49cd5bc7b995 service cinder] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:00.926758 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:00.975440 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:00.977040 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:00.977665 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:00.984870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] PATH_INFO: `/v3/projects/822e89fc41b14ff5bdedbd915ebb3e8f` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:00.984870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822e89fc41b14ff5bdedbd915ebb3e8f)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:00.984870 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:01.092035 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822e89fc41b14ff5bdedbd915ebb3e8f', 'request_id': 'req-18a8f8a5-c395-4672-a663-e112f2029f39'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.099607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822e89fc41b14ff5bdedbd915ebb3e8f', 'request_id': 'req-18a8f8a5-c395-4672-a663-e112f2029f39'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.111846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822e89fc41b14ff5bdedbd915ebb3e8f', 'request_id': 'req-18a8f8a5-c395-4672-a663-e112f2029f39'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.146262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:01.148514 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:01.148850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:01.180262 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] MFA Rules not processed for user `fcd3a153a847477fb9e0759607ffbf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:01.181783 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:01.213643 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] The token cache is being invalidate because project 822e89fc41b14ff5bdedbd915ebb3e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:58:01.213952 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.216010 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.219808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1413/2868] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:58:00 2022] DELETE /identity/v3/projects/822e89fc41b14ff5bdedbd915ebb3e8f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:58:01.220428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:01.221905 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:01.243897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:01.260915 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1456/2869] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:01.265272 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:01.277865 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:01.295590 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8f8a5-c395-4672-a663-e112f2029f39 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:01.300788 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:01.301675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:01.301675 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:01.301966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] PATH_INFO: `/v3/users/14ec1e03d3f6446fab6f73858843e170` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:01.303108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14ec1e03d3f6446fab6f73858843e170)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:01.305082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:01.337682 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d013d78-6e70-48ae-a7e7-92c175748e16 None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:01.342821 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:01.343431 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:01.343719 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:01.343999 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:01.344666 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:01.346571 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:01.427998 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1457/2870] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:58:01 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:58:01.431854 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:01.502764 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14ec1e03d3f6446fab6f73858843e170'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.503625 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14ec1e03d3f6446fab6f73858843e170'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.504414 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14ec1e03d3f6446fab6f73858843e170'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.513112 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14ec1e03d3f6446fab6f73858843e170'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.515038 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:01.515291 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bcfbc-2f13-416f-80fc-f0fb7132e113 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:01.520099 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:01.520751 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:01.521040 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:01.521324 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] PATH_INFO: `/v3/users` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:01.521962 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:01.524475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:01.614615 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14ec1e03d3f6446fab6f73858843e170'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:01.623205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1458/2871] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:58:01 2022] POST /identity/v3/users => generated 299 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:58:01.626733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:01.628574 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:01.645159 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1414/2872] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:58:01 2022] DELETE /identity/v3/users/14ec1e03d3f6446fab6f73858843e170 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:58:01.645394 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b6399-fbbb-4ab5-9dec-96b6ecf6ae10 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:01.739013 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:01.742587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:01.742587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:01.742587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:01.742587 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:01.742935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:01.758003 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1459/2873] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 22 05:58:01.762512 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:01.774033 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1df226-4c2a-4887-83ed-edc9f5b44868 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:01.788372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:01.789187 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:01.801150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:01.801150 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] PATH_INFO: `/v3/projects/f24000e16b064e828b4268517bd1f486/users/f589b120103547858ea097c712b5ba9e/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:01.839708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24000e16b064e828b4268517bd1f486, user_id=f589b120103547858ea097c712b5ba9e, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:01.842859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:01.925551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:01.927715 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:01.940458 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1415/2874] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:58:01 2022] PUT /identity/v3/projects/f24000e16b064e828b4268517bd1f486/users/f589b120103547858ea097c712b5ba9e/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:58:01.941919 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:01.953510 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:01.969429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ba4c6-cdcb-4869-b0e7-5f7a0216963b admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:02.042453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90c5e0-4b63-4f65-9ffd-ccffe56ca0f0 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:02.044965 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:02.045602 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:02.045935 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:02.046313 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] PATH_INFO: `/v3/projects/2b9beee5ff4547fc9e00e3cf090a8925` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:02.047365 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b9beee5ff4547fc9e00e3cf090a8925)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:02.048057 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:02.049330 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:02.050352 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:02.050641 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:02.051120 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:02.051946 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:02.053812 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:02.065468 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1416/2875] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:58:02.069530 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:02.081828 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8e505-656c-4041-be01-b868b12cc1fc admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:02.086924 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8d38c-71b9-4c79-8b00-d675f5d14162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:02.092107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8d38c-71b9-4c79-8b00-d675f5d14162 admin admin] REQUEST_METHOD: `PUT` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:02.092107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8d38c-71b9-4c79-8b00-d675f5d14162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:02.092107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8d38c-71b9-4c79-8b00-d675f5d14162 admin admin] PATH_INFO: `/v3/projects/f24000e16b064e828b4268517bd1f486/users/f589b120103547858ea097c712b5ba9e/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:02.092107 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8d38c-71b9-4c79-8b00-d675f5d14162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24000e16b064e828b4268517bd1f486, user_id=f589b120103547858ea097c712b5ba9e, role_id=0832d8bc9e8a4d3a8eef40d0f2c24ff1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:02.093313 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8d38c-71b9-4c79-8b00-d675f5d14162 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:02.104872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1417/2876] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:58:02 2022] PUT /identity/v3/projects/f24000e16b064e828b4268517bd1f486/users/f589b120103547858ea097c712b5ba9e/roles/0832d8bc9e8a4d3a8eef40d0f2c24ff1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:58:02.163490 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b9beee5ff4547fc9e00e3cf090a8925', 'request_id': 'req-96fb2dba-df89-43d2-a44f-bf9bca04a730'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:02.170555 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b9beee5ff4547fc9e00e3cf090a8925', 'request_id': 'req-96fb2dba-df89-43d2-a44f-bf9bca04a730'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:02.231831 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b9beee5ff4547fc9e00e3cf090a8925', 'request_id': 'req-96fb2dba-df89-43d2-a44f-bf9bca04a730'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:02.248577 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] The token cache is being invalidate because project 2b9beee5ff4547fc9e00e3cf090a8925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:58:02.248894 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:02.249672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:02.264557 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1460/2877] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:58:01 2022] DELETE /identity/v3/projects/2b9beee5ff4547fc9e00e3cf090a8925 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 22 05:58:07.701128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f256-58b5-4b07-88a3-5cdceae1aecd None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:07.702048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f256-58b5-4b07-88a3-5cdceae1aecd None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:07.702340 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f256-58b5-4b07-88a3-5cdceae1aecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:07.734096 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-7461f256-58b5-4b07-88a3-5cdceae1aecd None None] MFA Rules not processed for user `f589b120103547858ea097c712b5ba9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:07.735588 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-7461f256-58b5-4b07-88a3-5cdceae1aecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:07.836489 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1418/2878] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:07.857392 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:07.858944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:07.930333 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb2dba-df89-43d2-a44f-bf9bca04a730 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:07.934526 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d2e7ee450e44299a99cba466545701', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:07.934720 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:07.934997 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:07.935268 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:07.936989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:07.982027 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:08.013616 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:08.015156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:08.024764 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1461/2879] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:58:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:58:08.293646 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d61e-c06f-4adb-a95f-c26b2d35b05c None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:08.293933 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d61e-c06f-4adb-a95f-c26b2d35b05c None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:08.294214 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322d61e-c06f-4adb-a95f-c26b2d35b05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:08.314553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-5322d61e-c06f-4adb-a95f-c26b2d35b05c None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:08.315794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-5322d61e-c06f-4adb-a95f-c26b2d35b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:08.318482 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:08.403977 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1419/2880] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:58:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:08.561322 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:08.563621 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:08.658963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d64dc8-293f-4974-bee8-7de1e02b0dd0 service glance] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:08.664554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:08.665168 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:08.669768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:08.669768 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:08.674638 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:08.676364 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:08.686154 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1462/2881] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:58:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:58:18.458487 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=31 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:18.682156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=52 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:19.000274 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc75e6-e2ee-4782-9feb-92583b5cd0ca None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:19.000562 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc75e6-e2ee-4782-9feb-92583b5cd0ca None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:19.000846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc75e6-e2ee-4782-9feb-92583b5cd0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:19.021748 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-edcc75e6-e2ee-4782-9feb-92583b5cd0ca None None] MFA Rules not processed for user `fcd3a153a847477fb9e0759607ffbf7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:19.023082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-edcc75e6-e2ee-4782-9feb-92583b5cd0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:19.030787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1420/2882] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:21.173733 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:21.175308 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:21.267607 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251fd8e-58ce-4d04-8754-f69d07e279b1 service swift] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:21.272553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:21.273153 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:21.273429 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:21.273701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:21.275428 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:21.286952 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:21.288570 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:21.299390 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1463/2883] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:58:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:58:22.643453 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:22.643960 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:22.646324 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:22.676910 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:22.677804 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:22.685885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1421/2884] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Aug 22 05:58:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:22.699116 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:22.711098 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34b639-2f02-41d9-969c-966f0cf03193 service placement] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:22.716956 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f06c-8fac-480c-b342-c45d323c2a1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:22.720159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f06c-8fac-480c-b342-c45d323c2a1e service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:22.720549 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f06c-8fac-480c-b342-c45d323c2a1e service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:22.720841 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f06c-8fac-480c-b342-c45d323c2a1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:22.732182 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f06c-8fac-480c-b342-c45d323c2a1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:22.738151 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f06c-8fac-480c-b342-c45d323c2a1e service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:22.742205 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1464/2885] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 05:58:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 05:58:32.671346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=10 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:32.738903 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=47 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:35.253359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:35.254979 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:35.359664 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874dfc06-cb51-4d51-9f7b-955d8f528142 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:35.364221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:35.364859 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:35.365142 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:35.365422 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] PATH_INFO: `/v3/users/302acf9383244eafb4df14c3c842ab3d` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:35.369279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302acf9383244eafb4df14c3c842ab3d)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:35.372065 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:35.912912 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302acf9383244eafb4df14c3c842ab3d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:35.913316 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302acf9383244eafb4df14c3c842ab3d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:35.913922 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302acf9383244eafb4df14c3c842ab3d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:35.921350 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302acf9383244eafb4df14c3c842ab3d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:35.980148 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302acf9383244eafb4df14c3c842ab3d'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:35.997892 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1422/2886] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:58:35 2022] DELETE /identity/v3/users/302acf9383244eafb4df14c3c842ab3d => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:58:36.002897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:36.002897 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:36.003366 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:36.034345 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:36.035605 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:36.092243 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1465/2887] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:36.102406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:36.107325 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:36.158421 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:36.180499 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea5f04-c6a7-4bf1-9fc7-0215a77e9b18 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:36.184108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69df853-3d64-49aa-b812-4aa8a57829f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:36.184741 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df853-3d64-49aa-b812-4aa8a57829f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:36.185024 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df853-3d64-49aa-b812-4aa8a57829f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:36.185301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69df853-3d64-49aa-b812-4aa8a57829f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:36.194459 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69df853-3d64-49aa-b812-4aa8a57829f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:36.195885 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69df853-3d64-49aa-b812-4aa8a57829f8 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:36.205995 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1423/2888] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:58:36.626619 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:36.628082 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:36.640756 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5f486-c0a0-4506-9d87-2f5b37033f8d None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:36.645532 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:36.646160 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:36.646439 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:36.646712 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] PATH_INFO: `/v3/projects/1442c5f9adaf4d6e8ad06edf1ce16206` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:36.647988 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1442c5f9adaf4d6e8ad06edf1ce16206)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:36.651002 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:36.774701 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1442c5f9adaf4d6e8ad06edf1ce16206', 'request_id': 'req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:36.782301 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1442c5f9adaf4d6e8ad06edf1ce16206', 'request_id': 'req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:36.865467 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1442c5f9adaf4d6e8ad06edf1ce16206', 'request_id': 'req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:36.879906 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] The token cache is being invalidate because project 1442c5f9adaf4d6e8ad06edf1ce16206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:58:36.880281 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:36.880928 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-6be64a01-8fa7-499a-8b48-bf2fb8c2a3be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:36.882422 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1466/2889] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:58:36 2022] DELETE /identity/v3/projects/1442c5f9adaf4d6e8ad06edf1ce16206 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:58:36.887376 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1610bf-f9fd-4b8f-9a3d-222267ac1c26 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:36.887887 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1610bf-f9fd-4b8f-9a3d-222267ac1c26 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:36.888002 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1610bf-f9fd-4b8f-9a3d-222267ac1c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:36.938831 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-8a1610bf-f9fd-4b8f-9a3d-222267ac1c26 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:36.940124 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8a1610bf-f9fd-4b8f-9a3d-222267ac1c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:36.999884 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1424/2890] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:37.007823 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76ca49-2bd6-4cff-8677-2a684d88c99e None None] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.008437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76ca49-2bd6-4cff-8677-2a684d88c99e None None] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.008437 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76ca49-2bd6-4cff-8677-2a684d88c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.028234 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.auth.core [None req-fe76ca49-2bd6-4cff-8677-2a684d88c99e None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82145) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:37.029433 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-fe76ca49-2bd6-4cff-8677-2a684d88c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:37.037340 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1467/2891] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:58:37.041560 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1610bf-f9fd-4b8f-9a3d-222267ac1c26 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:37.051875 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1610bf-f9fd-4b8f-9a3d-222267ac1c26 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:37.056501 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:37.057108 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.057392 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.058210 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] PATH_INFO: `/v3/domains` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.058871 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82146) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 22 05:58:37.059179 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:37.060811 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:37.072717 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1425/2892] 10.222.0.27 () {58 vars in 1153 bytes} [Mon Aug 22 05:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 22 05:58:37.076860 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76ca49-2bd6-4cff-8677-2a684d88c99e None None] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:37.087318 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76ca49-2bd6-4cff-8677-2a684d88c99e None None] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:37.092010 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:37.092901 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] REQUEST_METHOD: `POST` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.093183 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.093458 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] PATH_INFO: `/v3/projects` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.094089 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:37.095989 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:37.192627 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1468/2893] 10.222.0.27 () {60 vars in 1153 bytes} [Mon Aug 22 05:58:37 2022] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 22 05:58:37.197223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:37.210808 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c846c2b-6da3-4e2d-8235-4b8d3ee52003 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:37.266279 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:37.266796 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.267078 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.267510 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] PATH_INFO: `/v3/users` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.268145 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:37.270068 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:37.357749 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1426/2894] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Aug 22 05:58:37 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 22 05:58:37.361950 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:37.372343 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5625f31c-5183-4a8b-b560-23210f1cd99e admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:37.376941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:37.377534 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.377818 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.378161 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.378828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:37.380462 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:37.390408 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1469/2895] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:58:37.394382 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:37.404756 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c89d5-e186-4af9-80ee-054027fefa4a admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:37.409379 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4d8b-3309-410d-b004-2032113a69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:37.409970 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4d8b-3309-410d-b004-2032113a69e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.410258 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4d8b-3309-410d-b004-2032113a69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.410538 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4d8b-3309-410d-b004-2032113a69e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.411215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4d8b-3309-410d-b004-2032113a69e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:37.412839 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4d8b-3309-410d-b004-2032113a69e4 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:37.425273 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1427/2896] 10.222.0.27 () {58 vars in 1122 bytes} [Mon Aug 22 05:58:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 22 05:58:37.429671 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:37.439475 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e139214-48d2-4916-aaea-d879d74834fe admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:37.444120 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:37.444802 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.445193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.445480 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] PATH_INFO: `/v3/projects/9bbc377a86cf454087ec9ba1579411c1/users/22ccae08e9274b62b7062395288a44c9/roles/6ba30e1147874694ad926bff7dd0bfc9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.459963 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbc377a86cf454087ec9ba1579411c1, user_id=22ccae08e9274b62b7062395288a44c9, role_id=6ba30e1147874694ad926bff7dd0bfc9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:37.463411 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:37.528323 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1470/2897] 10.222.0.27 () {60 vars in 1483 bytes} [Mon Aug 22 05:58:37 2022] PUT /identity/v3/projects/9bbc377a86cf454087ec9ba1579411c1/users/22ccae08e9274b62b7062395288a44c9/roles/6ba30e1147874694ad926bff7dd0bfc9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:58:37.540081 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854686-b918-4214-a41f-d5b375320f95 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.540403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854686-b918-4214-a41f-d5b375320f95 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.540683 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36854686-b918-4214-a41f-d5b375320f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.567372 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-36854686-b918-4214-a41f-d5b375320f95 None None] MFA Rules not processed for user `22ccae08e9274b62b7062395288a44c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:37.568633 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-36854686-b918-4214-a41f-d5b375320f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:37.572578 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:37.633923 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1428/2898] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 22 05:58:37.645484 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:37.647287 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:37.665509 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:37.726718 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4905a0b-92fd-4c0f-b950-00c0bdd7b1cf admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:37.730481 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1af7582d3e94be1815574887e988e2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:37.731083 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:37.734012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:37.734012 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:37.740097 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:37.741552 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:37.751713 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1471/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:58:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:58:44.684699 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36854686-b918-4214-a41f-d5b375320f95 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:44.686221 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-36854686-b918-4214-a41f-d5b375320f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:44.744174 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36854686-b918-4214-a41f-d5b375320f95 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:44.747791 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e55fe4-d037-46e5-92b1-c2b0aece4734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:44.748428 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55fe4-d037-46e5-92b1-c2b0aece4734 service neutron] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:44.748708 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55fe4-d037-46e5-92b1-c2b0aece4734 service neutron] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:44.748983 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e55fe4-d037-46e5-92b1-c2b0aece4734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:44.750752 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-a1e55fe4-d037-46e5-92b1-c2b0aece4734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:44.811359 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e55fe4-d037-46e5-92b1-c2b0aece4734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:44.812840 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e55fe4-d037-46e5-92b1-c2b0aece4734 service neutron] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:44.822098 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1429/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:58:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 05:58:47.751887 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=29 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:49.312551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:49.377578 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e492ec7-93f6-460d-8629-fae2681d9683 service cinder] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:49.382171 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:49.382877 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:49.383184 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:49.383465 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] PATH_INFO: `/v3/users/22ccae08e9274b62b7062395288a44c9` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:49.384685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ccae08e9274b62b7062395288a44c9)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:49.386596 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:49.582584 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ccae08e9274b62b7062395288a44c9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:49.583244 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ccae08e9274b62b7062395288a44c9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:49.584014 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ccae08e9274b62b7062395288a44c9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:49.597043 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ccae08e9274b62b7062395288a44c9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:49.665186 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ccae08e9274b62b7062395288a44c9'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:49.677795 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1472/2901] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 05:58:49 2022] DELETE /identity/v3/users/22ccae08e9274b62b7062395288a44c9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:58:49.682264 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:49.682737 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:49.682846 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:49.704849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] MFA Rules not processed for user `3e08281e8e384df6a2e274a09e73725b`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 05:58:49.705851 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:49.766129 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=100 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:58:49.780128 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1430/2902] 10.222.0.27 () {58 vars in 958 bytes} [Mon Aug 22 05:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 05:58:49.791729 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:49.793772 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:49.864554 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765bdd3-606d-4d5d-8336-4da759078b73 admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:49.868685 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:49.869434 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:49.869825 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:49.870193 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:49.884187 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:49.886689 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:49.900292 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1473/2903] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 05:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 22 05:58:50.462553 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 05:58:50.467585 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 05:58:50.489763 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b8dd0-baf3-4a0b-ac4e-1853c9703575 None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 05:58:50.495335 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 05:58:50.496084 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 05:58:50.496412 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 05:58:50.496686 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] PATH_INFO: `/v3/projects/9bbc377a86cf454087ec9ba1579411c1` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 05:58:50.497849 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbc377a86cf454087ec9ba1579411c1)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 05:58:50.500722 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 05:58:50.614659 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbc377a86cf454087ec9ba1579411c1', 'request_id': 'req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:50.620908 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbc377a86cf454087ec9ba1579411c1', 'request_id': 'req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:50.626375 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbc377a86cf454087ec9ba1579411c1', 'request_id': 'req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:50.698607 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] The token cache is being invalidate because project 9bbc377a86cf454087ec9ba1579411c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82146) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 05:58:50.699226 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:50.699535 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-2fc8dbb6-a5db-45c2-a3f6-485e490bbe0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 05:58:50.701077 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1431/2904] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 05:58:50 2022] DELETE /identity/v3/projects/9bbc377a86cf454087ec9ba1579411c1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 05:58:59.894056 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 05:59:00.695472 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:09.035615 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 06:00:09.044391 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa1106-be75-42aa-aa86-e564336175d0 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 06:00:09.091672 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d46d5905b004073b10e694ab79e7187', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 06:00:09.092293 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:00:09.092601 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:00:09.092876 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:00:09.094592 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:00:09.172604 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 06:00:09.174037 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 06:00:09.193359 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1474/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 06:00:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 06:00:10.441653 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] REQUEST_METHOD: `POST` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:00:10.442115 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:00:10.442215 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:00:10.461403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.auth.core [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] MFA Rules not processed for user `2023824207074cc89a027c15b8425474`. Rule list: `[]` (Enabled: `True`). {{(pid=82146) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 22 06:00:10.462586 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:00:10.516213 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1432/2906] 10.222.0.27 () {58 vars in 967 bytes} [Mon Aug 22 06:00:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 22 06:00:10.555551 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 06:00:10.557028 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:00:10.624159 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28562b7-c22a-4225-85cd-bc6d711f27b4 service neutron] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 06:00:10.629156 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9800dbdc23794d9eb02e3c2002b096b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 06:00:10.629758 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] REQUEST_METHOD: `GET` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:00:10.630044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:00:10.630326 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:00:10.638736 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 06:00:10.640370 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 06:00:10.648902 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1475/2907] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Aug 22 06:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 22 06:00:18.266753 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 06:00:18.268223 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:00:18.338277 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe6dce-6d33-4a63-9411-79199d010dce None None] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 06:00:18.342787 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 06:00:18.343466 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:00:18.343701 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:00:18.343973 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] PATH_INFO: `/v3/users/fcd3a153a847477fb9e0759607ffbf7e` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:00:18.345399 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd3a153a847477fb9e0759607ffbf7e)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 06:00:18.347311 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 06:00:18.478966 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd3a153a847477fb9e0759607ffbf7e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:18.479640 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd3a153a847477fb9e0759607ffbf7e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:18.480301 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd3a153a847477fb9e0759607ffbf7e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:18.488082 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd3a153a847477fb9e0759607ffbf7e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:18.527957 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd3a153a847477fb9e0759607ffbf7e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:18.545328 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1433/2908] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 06:00:18 2022] DELETE /identity/v3/users/fcd3a153a847477fb9e0759607ffbf7e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 06:00:18.769228 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 06:00:18.780015 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca0788-02c5-49d3-ad11-6a9b6dbd3800 service swift] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 06:00:18.788101 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=100 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:18.843864 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 06:00:18.844545 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:00:18.844828 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:00:18.845103 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] PATH_INFO: `/v3/projects/094591e096674a7cb778642219d766ad` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:00:18.846741 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=094591e096674a7cb778642219d766ad)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 06:00:18.848722 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 06:00:18.952792 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094591e096674a7cb778642219d766ad', 'request_id': 'req-73d8e689-2aa2-4759-b373-569bbae27aeb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:18.959235 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094591e096674a7cb778642219d766ad', 'request_id': 'req-73d8e689-2aa2-4759-b373-569bbae27aeb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.019361 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094591e096674a7cb778642219d766ad', 'request_id': 'req-73d8e689-2aa2-4759-b373-569bbae27aeb'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.030137 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] The token cache is being invalidate because project 094591e096674a7cb778642219d766ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 06:00:19.030424 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.031044 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.032553 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1476/2909] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 06:00:18 2022] DELETE /identity/v3/projects/094591e096674a7cb778642219d766ad => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 06:00:19.036496 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 06:00:19.037945 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:00:19.052229 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8d158-32d0-4ffd-91cc-4c335c1d5f23 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 06:00:19.072381 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:19.110433 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 06:00:19.111059 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:00:19.111346 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:00:19.111624 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] PATH_INFO: `/v3/users/f589b120103547858ea097c712b5ba9e` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:00:19.112794 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f589b120103547858ea097c712b5ba9e)` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 06:00:19.114694 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 06:00:19.267048 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f589b120103547858ea097c712b5ba9e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.267680 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f589b120103547858ea097c712b5ba9e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.268250 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f589b120103547858ea097c712b5ba9e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.275162 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f589b120103547858ea097c712b5ba9e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.328281 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.notifications [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f589b120103547858ea097c712b5ba9e'} {{(pid=82146) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.346205 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1434/2910] 10.222.0.27 () {58 vars in 1224 bytes} [Mon Aug 22 06:00:19 2022] DELETE /identity/v3/users/f589b120103547858ea097c712b5ba9e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 06:00:19.564032 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Authenticating user token {{(pid=82145) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 06:00:19.565533 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.fernet_utils [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82145) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:00:19.580944 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8e689-2aa2-4759-b373-569bbae27aeb admin admin] Validating token access rules against request {{(pid=82145) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 06:00:19.637723 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3e08281e8e384df6a2e274a09e73725b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db1aad17b68042eda5d90f159ce8fc85', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82145) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 06:00:19.638351 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:00:19.638668 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:00:19.638931 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] PATH_INFO: `/v3/projects/f24000e16b064e828b4268517bd1f486` {{(pid=82145) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:00:19.640052 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24000e16b064e828b4268517bd1f486)` {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 06:00:19.642000 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] RBAC: Authorization granted {{(pid=82145) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 06:00:19.719198 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:19.722850 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24000e16b064e828b4268517bd1f486', 'request_id': 'req-e7091706-53a6-497b-9ca6-c2041cd7c118'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.728832 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24000e16b064e828b4268517bd1f486', 'request_id': 'req-e7091706-53a6-497b-9ca6-c2041cd7c118'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.773845 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24000e16b064e828b4268517bd1f486', 'request_id': 'req-e7091706-53a6-497b-9ca6-c2041cd7c118'} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.784649 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] The token cache is being invalidate because project f24000e16b064e828b4268517bd1f486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82145) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 22 06:00:19.784941 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.785565 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG keystone.notifications [None req-e7091706-53a6-497b-9ca6-c2041cd7c118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82145) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 22 06:00:19.787029 dv-cinder-853910-1-smb devstack@keystone.service[82145]: [pid: 82145|app: 0|req: 1477/2911] 10.222.0.27 () {58 vars in 1233 bytes} [Mon Aug 22 06:00:19 2022] DELETE /identity/v3/projects/f24000e16b064e828b4268517bd1f486 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 22 06:00:29.342515 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:00:29.825644 dv-cinder-853910-1-smb devstack@keystone.service[82145]: DEBUG dbcounter [-] [82145] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82145) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 06:03:21.590104 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Authenticating user token {{(pid=82146) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 22 06:03:21.591490 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:03:21.660338 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e441-2b06-487c-896b-0b40f5adb424 admin admin] Validating token access rules against request {{(pid=82146) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 22 06:03:21.717798 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39988f44-00d7-4739-93fa-19e3877d8e7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '908320440dfe4e8783d77b7d385b43fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee73da9fed67459498f499aa2ca135ec', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82146) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 22 06:03:21.718406 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988f44-00d7-4739-93fa-19e3877d8e7c service placement] REQUEST_METHOD: `GET` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 22 06:03:21.718695 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988f44-00d7-4739-93fa-19e3877d8e7c service placement] SCRIPT_NAME: `/identity` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 22 06:03:21.718971 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39988f44-00d7-4739-93fa-19e3877d8e7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82146) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 22 06:03:21.720719 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.fernet_utils [None req-39988f44-00d7-4739-93fa-19e3877d8e7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82146) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 22 06:03:21.731806 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39988f44-00d7-4739-93fa-19e3877d8e7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 22 06:03:21.733403 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39988f44-00d7-4739-93fa-19e3877d8e7c service placement] RBAC: Authorization granted {{(pid=82146) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 22 06:03:21.743556 dv-cinder-853910-1-smb devstack@keystone.service[82146]: [pid: 82146|app: 0|req: 1435/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Aug 22 06:03:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 22 06:03:31.738872 dv-cinder-853910-1-smb devstack@keystone.service[82146]: DEBUG dbcounter [-] [82146] Writing DB stats keystone:SELECT=58 {{(pid=82146) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}